00000001:02000400:1.0F:1788612280.158717:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788612297.878283:0:3526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788612299.424026:0:3588:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 939 MB/s 00000001:01000000:1.0:1788612299.674229:0:3588:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1119 MB/s 00000001:01000000:3.0F:1788612299.923613:0:3588:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5255 MB/s 00000020:02000000:0.0:1788612300.659732:0:3617:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_ge9089f3 00000400:02000000:0.0:1788612301.394573:0:3632:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.130@tcp [8/256/0/180] 00008000:02000000:2.0:1788612304.666884:0:3782:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788612361.579240:0:5750:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788612377.736229:0:6500:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612377.736235:0:6500:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788612377.736236:0:6500:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788612377.736367:0:6500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006908d39a 00000080:02000400:1.0:1788612377.736376:0:6500:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788612377.753340:0:6500:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788612377.753351:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788612377.753376:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000160adb7d) 00000020:00000080:1.0:1788612377.753392:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788612377.839615:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788612377.839710:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788612377.892616:0:6500:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788612377.892849:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788612377.892856:0:6500:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788612377.892868:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7abf 00000020:01000004:3.0:1788612377.892874:0:6500:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788612377.892879:0:6500:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788612377.892883:0:6500:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006908d39a from MGS 00000020:01000004:3.0:1788612377.892887:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788612377.892904:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002e673876) 00000020:00000080:3.0:1788612377.892914:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788612377.893035:0:6500:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006908d39a from MGS, refs=2 00080000:01000000:3.0:1788612377.893041:0:6500:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788612377.893045:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7acd 00000100:00100000:3.0:1788612377.893139:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788612377.893272:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788612377.893278:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788612377.894656:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788612377.894667:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788612377.896291:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612377.896445:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788612377.896450:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788612377.897907:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788612377.897918:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788612377.898508:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788612377.898515:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788612377.899402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612377.899406:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612377.899407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612377.899753:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612377.899756:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612377.899757:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612377.900251:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788612377.904848:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788612378.150138:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2655 MB/s 00000001:01000000:0.0:1788612378.408443:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2387 MB/s 00000001:01000000:3.0:1788612378.662129:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 385 MB/s 00000001:01000000:2.0:1788612378.912326:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 715 MB/s 00010000:00010000:0.0:1788612378.928110:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788612378.930039:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788612378.944321:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788612378.949325:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788612378.949419:0:6500:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788612378.949508:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788612378.949692:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788612378.949713:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788612378.950063:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612378.950228:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788612378.950240:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788612378.952551:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788612378.952561:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788612378.954020:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788612378.954029:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788612378.962567:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788612378.962590:0:6500:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:3.0:1788612378.962592:0:6500:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788612378.962646:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:3.0:1788612378.962657:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (00000000310cb22b) 00000020:00000080:3.0:1788612378.962673:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1788612378.962931:0:6519:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:3.0:1788612378.963359:0:6500:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ac86d8be@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612378.963671:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:3.0:1788612378.963678:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788612378.969300:0:6520:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788612378.971743:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid d04a0405-b620-42fe-8569-8c55f54b9b5e) 00000020:00000080:0.0:1788612378.971824:0:6500:0:(genops.c:1385:class_connect()) connect: client d04a0405-b620-42fe-8569-8c55f54b9b5e, cookie 0x1f8616bf0bc7adb 00000100:00080000:0.0:1788612378.971835:0:6500:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612378.971840:0:6500:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import 00000000ac86d8be using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612378.971884:0:6500:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005ed77748 x1875495932133504/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612378.971921:0:6500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS 00000020:01000004:0.0:1788612378.971938:0:6500:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788612378.971942:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788612378.971960:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000038fbac06) 00000020:00000080:0.0:1788612378.971971:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788612378.972943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed77748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d04a0405-b620-42fe-8569-8c55f54b9b5e:3647:1875495932133504:0@lo:250: 00000100:00100000:3.0:1788612378.973036:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612378.973105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932133504 00000100:00100000:3.0:1788612378.973112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932133504 00000100:00100000:3.0:1788612378.973142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612378.973149:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cfe25a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875495932133504:12345-0@lo:250: 00010000:00080000:3.0:1788612378.973172:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d04a0405-b620-42fe-8569-8c55f54b9b5e@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1788612378.973195:0:6516:0:(genops.c:1385:class_connect()) connect: client d04a0405-b620-42fe-8569-8c55f54b9b5e, cookie 0x1f8616bf0bc7ae9 00000100:00080000:3.0:1788612378.973322:0:6516:0:(import.c:65:import_set_state_nolock()) 000000005319f0ef : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612378.973369:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cfe25a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:3647:x1875495932133504:12345-0@lo:250: Request processed in 219us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612378.973376:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612378.973412:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788612378.973420:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788612378.973426:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788612378.973429:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788612378.973432:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000ac86d8be MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788612378.973440:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788612378.973447:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788612378.973464:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed77748 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d04a0405-b620-42fe-8569-8c55f54b9b5e:3647:1875495932133504:0@lo:250: 00000100:00100000:0.0:1788612378.995656:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612378.995905:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788612378.995921:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788612378.998352:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788612378.998365:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788612378.999202:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788612378.999210:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788612379.006167:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612379.006374:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788612379.006383:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788612379.008673:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788612379.008685:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788612379.091186:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612379.093762:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788612379.093770:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788612379.104386:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788612379.104401:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788612379.108988:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612379.109171:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788612379.109177:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788612379.120690:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788612379.120705:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788612379.121589:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612379.121772:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788612379.121778:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788612379.131636:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612379.132182:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788612379.136268:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612379.138634:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612379.138648:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788612379.139347:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612379.139354:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788612379.160461:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612379.160697:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788612379.160704:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788612379.163231:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612379.163245:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788612379.166287:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788612379.166301:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788612379.167347:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788612379.167375:0:6500:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788612379.167380:0:6500:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788612379.167690:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788612379.167723:0:6500:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788612379.167726:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788612379.167728:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612379.167730:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612379.167731:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612379.167732:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612379.167733:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612379.167734:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612379.167736:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612379.167737:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612379.167738:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612379.167740:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612379.167741:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612379.167743:0:6500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788612379.167745:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612379.167746:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612379.167751:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612379.167752:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612379.167753:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612379.167754:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612379.167755:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612379.167755:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612379.167756:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612379.167757:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612379.167758:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612379.167758:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612379.167855:0:6500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788612379.167870:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024a109a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932133632:0@lo:253: 00000100:00100000:2.0:1788612379.168012:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.168096:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d405f375 going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.168138:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932133632 00000100:00100000:3.0:1788612379.168146:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932133632 00000100:00100000:3.0:1788612379.168233:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612379.168241:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c614d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6500:x1875495932133632:12345-0@lo:253: 20000000:01000000:3.0:1788612379.168283:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788612379.168286:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788612379.168654:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788612379.168703:0:6518:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788612379.169103:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612379.175108:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788612379.175947:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788612379.175952:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788612379.175958:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788612379.175961:0:6518:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788612379.175973:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788612379.176146:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612379.176312:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788612379.176325:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788612379.176340:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788612379.176354:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788612379.176365:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788612379.176408:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788612379.176415:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788612379.176425:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788612379.176429:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788612379.176437:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788612379.176442:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788612379.176624:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788612379.176642:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788612379.176666:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788612379.176671:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788612379.176676:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612379.177040:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788612379.177050:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788612379.177064:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788612379.177077:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788612379.177090:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788612379.177098:0:6518:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788612379.177121:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788612379.177128:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788612379.177138:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788612379.177150:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788612379.177163:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788612379.177170:0:6518:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788612379.177204:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788612379.177212:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788612379.177222:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788612379.177234:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788612379.177302:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788612379.177323:0:6518:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788612379.177330:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788612379.180881:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788612379.181185:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788612379.181210:0:6518:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:1.0:1788612379.181212:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1788612379.181227:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788612379.181233:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788612379.181244:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788612379.181249:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1788612379.181258:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788612379.181265:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788612379.181277:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788612379.181293:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788612379.181319:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788612379.181322:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788612379.181326:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788612379.181366:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788612379.181368:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788612379.182103:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788612379.182246:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788612379.182262:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788612379.182277:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788612379.182285:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788612379.182287:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788612379.184091:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788612379.184308:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788612379.184332:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788612379.184344:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788612379.184357:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788612379.184359:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788612379.184364:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788612379.184366:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788612379.184382:0:6518:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788612379.184389:0:6518:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788612379.190724:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788612379.194051:0:6518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788612379.204614:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788612379.204662:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788612379.204675:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788612379.204694:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788612379.204713:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204740:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204749:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204755:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204761:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204829:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204835:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068802405 already unused, calling callback (00000000d11f7c87) 00010000:00010000:0.0:1788612379.204838:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204846:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204857:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204865:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.204880:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068802405/0x1f8616bf0bc7af0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788612379.204901:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788612379.215622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c614d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6500:x1875495932133632:12345-0@lo:253: Request processed in 47374us (47603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612379.215640:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612379.215753:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024a109a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932133632:0@lo:253: 10000000:01000000:1.0:1788612379.215780:0:6500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788612379.215783:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612379.215785:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788612379.215787:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612379.215788:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788612379.215789:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612379.215790:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612379.215791:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612379.215793:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788612379.215794:0:6500:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788612379.215795:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612379.215797:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788612379.215815:0:6500:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006908d39a from lustre-MDT0000 10000000:01000000:1.0:1788612379.215855:0:6500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788612379.215859:0:6500:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788612379.215863:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9612d1e64d40 10000000:01000000:1.0:1788612379.215867:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612379.215874:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9612d1e64d40 from 1 10000000:01000000:1.0:1788612379.215877:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788612379.215929:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.215939:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.215948:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612379.215975:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932133760:0@lo:101: 00000100:00100000:1.0:1788612379.216010:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.216057:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000005918505d going to sleep for 11 seconds 00000100:00100000:0.0:1788612379.216179:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932133760 00000100:00100000:0.0:1788612379.216186:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932133760 00000100:00100000:0.0:1788612379.216229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612379.216237:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a50ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6500:x1875495932133760:12345-0@lo:101: 00010000:00010000:0.0:1788612379.216248:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612379.216259:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7af7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.216280:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.216289:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.216296:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068802405, rc 0) 00000100:00100000:0.0:1788612379.216332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a50ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:6500:x1875495932133760:12345-0@lo:101: Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612379.216338:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612379.216410:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932133760:0@lo:101: 00010000:00010000:1.0:1788612379.216423:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.216431:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612379.216498:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932133888:0@lo:501: 00000100:00100000:1.0:1788612379.216524:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.216535:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000005918505d going to sleep for 11 seconds 00000100:00100000:0.0:1788612379.216582:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932133888 00000100:00100000:0.0:1788612379.216586:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932133888 00000100:00100000:0.0:1788612379.216608:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612379.216621:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000429b7610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:6500:x1875495932133888:12345-0@lo:501: 00000100:00100000:0.0:1788612379.216693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000429b7610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:6500:x1875495932133888:12345-0@lo:501: Request processed in 72us (168us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612379.216699:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612379.216755:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932133888:0@lo:501: 10000000:01000000:1.0:1788612379.216788:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788612379.216806:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.216813:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612379.216819:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612c7237000 10000000:01000000:1.0:1788612379.216822:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612379.216825:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9612c7237000 10000000:01000000:1.0:1788612379.216827:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788612379.216829:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9612c7237000 from 1 10000000:01000000:1.0:1788612379.216835:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788612379.216849:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.216855:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.216862:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612379.216871:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134016:0@lo:101: 00000100:00100000:1.0:1788612379.216898:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.216924:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000005918505d going to sleep for 11 seconds 00000100:00100000:0.0:1788612379.217020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134016 00000100:00100000:0.0:1788612379.217025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134016 00000100:00100000:0.0:1788612379.217055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612379.217060:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3bcda3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:6500:x1875495932134016:12345-0@lo:101: 00010000:00010000:0.0:1788612379.217067:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612379.217075:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048697d9a/0x1f8616bf0bc7b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7b05 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.217087:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048697d9a/0x1f8616bf0bc7b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b05 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.217095:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048697d9a/0x1f8616bf0bc7b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b05 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612379.217101:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048697d9a, rc 0) 00000100:00100000:0.0:1788612379.217127:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3bcda3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:6500:x1875495932134016:12345-0@lo:101: Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612379.217133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612379.217298:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134016:0@lo:101: 00010000:00010000:1.0:1788612379.217307:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217314:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612379.217324:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788612379.217339:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217345:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000890376a3/0x1f8616bf0bc7b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612379.217351:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788612379.217354:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612379.217357:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9612c7237000 10000000:01000000:1.0:1788612379.217366:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788612379.217369:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788612379.217371:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612379.217385:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217391:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217397:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612379.217407:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134144:0@lo:101: 00000100:00100000:1.0:1788612379.217431:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.217442:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000005918505d going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.217467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134144 00000100:00100000:1.0:1788612379.217471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134144 00000100:00100000:1.0:1788612379.217514:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612379.217519:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5e31f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:6500:x1875495932134144:12345-0@lo:101: 00010000:00010000:1.0:1788612379.217526:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612379.217532:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217545:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217552:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217558:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0b4bfc3, rc 0) 00000100:00100000:1.0:1788612379.217591:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5e31f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+8:6500:x1875495932134144:12345-0@lo:101: Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.217596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612379.217620:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134144:0@lo:101: 00010000:00010000:1.0:1788612379.217629:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.217635:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612379.217671:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134272:0@lo:501: 00000100:00100000:1.0:1788612379.217694:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.217715:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000005918505d going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.217732:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134272 00000100:00100000:1.0:1788612379.217736:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134272 00000100:00100000:1.0:1788612379.217751:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612379.217755:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000799bb0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+8:6500:x1875495932134272:12345-0@lo:501: 00000100:00100000:1.0:1788612379.218970:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000799bb0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6500:x1875495932134272:12345-0@lo:501: Request processed in 1211us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.218979:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612379.219074:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f65d43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134272:0@lo:501: 00000100:00100000:0.0:1788612379.219108:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098ebb5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134400:0@lo:503: 00000100:00100000:0.0:1788612379.219150:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612379.219175:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a149505a going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.219291:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134400 00000100:00100000:3.0:1788612379.219297:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134400 00000100:00100000:3.0:1788612379.219328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612379.219335:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024e661f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6500:x1875495932134400:12345-0@lo:503: 00000100:00100000:3.0:1788612379.219422:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024e661f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6500:x1875495932134400:12345-0@lo:503: Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.219428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612379.220725:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098ebb5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134400:0@lo:503: 00000100:00100000:1.0:1788612379.221749:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4e764fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6545:1875495932134528:0@lo:502: 00000100:00100000:1.0:1788612379.221826:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.221869:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038623864 going to sleep for 11 seconds 00000100:00100000:2.0:1788612379.221935:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134528 00000100:00100000:2.0:1788612379.221940:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134528 00000100:00100000:2.0:1788612379.221989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612379.221996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a8c65f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6545:x1875495932134528:12345-0@lo:502: 00000100:00100000:2.0:1788612379.222105:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a8c65f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6545:x1875495932134528:12345-0@lo:502: Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612379.222112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612379.222305:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4e764fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6545:1875495932134528:0@lo:502: 00000020:01000000:3.0:1788612379.222328:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612379.222337:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612379.222339:0:6545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788612379.222344:0:6545:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788612379.222346:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612379.222357:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f23507f5) 00000020:00000080:3.0:1788612379.222371:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788612379.222376:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788612379.222447:0:6545:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788612379.222453:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7b28 00000020:00000080:3.0:1788612379.222678:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788612379.222683:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612379.222687:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612379.222688:0:6545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788612379.222690:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612379.222694:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612379.222695:0:6545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788612379.222698:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612379.222704:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002684338c) 00000020:00000080:3.0:1788612379.222714:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788612379.222717:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788612379.222719:0:6545:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788612379.222721:0:6545:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788612379.222727:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788612379.222767:0:6545:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006908d39a from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788612379.222786:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b83d75b7) 00000020:00000080:3.0:1788612379.222795:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788612379.222858:0:6545:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788612379.222865:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7b3d 00000020:00000080:3.0:1788612379.222991:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788612379.222997:0:6545:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788612379.223006:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1f8616bf0bc7b44 00080000:01000000:3.0:1788612379.223011:0:6545:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788612379.223014:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7b4b 00080000:10000000:3.0:1788612379.223402:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788612379.223571:0:6545:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788612379.235313:0:6545:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788612379.364436:0:6545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788612379.364815:0:6545:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788612379.369238:0:6545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788612379.372403:0:6545:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788612379.377978:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000019c65dc6) 00000020:00000080:1.0:1788612379.378006:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788612379.378077:0:6545:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788612379.378085:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7b59 00000020:00000080:2.0:1788612379.379649:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788612379.380394:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.387108:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.402048:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.405322:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788612379.413431:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.417387:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788612379.437716:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1f8616bf0bc7b60 00000020:00000080:2.0:1788612379.438410:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788612379.438421:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612379.438427:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612379.438429:0:6545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788612379.438432:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612379.438435:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612379.438437:0:6545:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612379.438440:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612379.438441:0:6545:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612379.438444:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612379.438446:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612379.438447:0:6545:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612379.438449:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612379.438453:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612379.438454:0:6545:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788612379.438458:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788612379.438634:0:6545:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788612379.438689:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4afe121 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6545:1875495932134656:0@lo:502: 00000100:00100000:2.0:1788612379.440917:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.441034:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 000000005505542d going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.441695:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134656 00000100:00100000:3.0:1788612379.441703:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134656 00000100:00100000:3.0:1788612379.441750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612379.441758:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a8b3bef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6545:x1875495932134656:12345-0@lo:502: 00000100:00100000:3.0:1788612379.442151:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a8b3bef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6545:x1875495932134656:12345-0@lo:502: Request processed in 392us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.442159:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612379.443687:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4afe121 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6545:1875495932134656:0@lo:502: 00000020:01000000:0.0:1788612379.443752:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612379.443760:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612379.443762:0:6545:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788612379.443767:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788612379.443963:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788612379.443984:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788612379.444004:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.444016:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612379.444023:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c7237000 from 1 10000000:01000000:2.0:1788612379.444025:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788612379.444061:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.444074:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.444082:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612379.444099:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134784:0@lo:101: 00000100:00100000:2.0:1788612379.444152:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.444190:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d7dc3cd going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.444309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134784 00000100:00100000:1.0:1788612379.444316:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134784 00000100:00100000:1.0:1788612379.444353:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612379.444361:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d79f76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:6500:x1875495932134784:12345-0@lo:101: 00010000:00010000:1.0:1788612379.444372:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612379.444386:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7b67 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.444405:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.444415:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612379.444423:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb931501, rc 0) 00000100:00100000:1.0:1788612379.444465:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d79f76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+10:6500:x1875495932134784:12345-0@lo:101: Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.444471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612379.450571:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134784:0@lo:101: 00010000:00010000:2.0:1788612379.450598:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.450610:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612379.451190:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134912:0@lo:256: 00000100:00100000:2.0:1788612379.451249:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.451286:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d7dc3cd going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.451522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932134912 00000100:00100000:1.0:1788612379.451537:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932134912 00000100:00100000:1.0:1788612379.451582:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612379.451591:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ac3f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+10:6500:x1875495932134912:12345-0@lo:256: 20000000:01000000:1.0:1788612379.451609:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788612379.451614:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788612379.451693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ac3f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+10:6500:x1875495932134912:12345-0@lo:256: Request processed in 104us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.451701:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612379.454748:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932134912:0@lo:256: 10000000:01000000:2.0:1788612379.455302:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612379.455325:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.455336:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612379.455970:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c7237000 from 1 10000000:01000000:2.0:1788612379.455973:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612379.456007:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.456015:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.456023:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612379.456041:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135040:0@lo:101: 00000100:00100000:2.0:1788612379.456095:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.456132:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d7dc3cd going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.456449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135040 00000100:00100000:3.0:1788612379.456456:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135040 00000100:00100000:3.0:1788612379.456507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612379.456516:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f2f1d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+10:6500:x1875495932135040:12345-0@lo:101: 00010000:00010000:3.0:1788612379.456527:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612379.456552:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7b75 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.456572:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.456581:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.456589:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049e67f65, rc 0) 00000100:00100000:3.0:1788612379.456632:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f2f1d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6500:x1875495932135040:12345-0@lo:101: Request processed in 117us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.456647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612379.456821:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135040:0@lo:101: 00010000:00010000:2.0:1788612379.456836:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.456844:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612379.456895:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135168:0@lo:501: 00000100:00100000:2.0:1788612379.456932:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.456958:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d7dc3cd going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.457221:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135168 00000100:00100000:1.0:1788612379.457226:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135168 00000100:00100000:1.0:1788612379.457256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612379.457262:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002791494a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6500:x1875495932135168:12345-0@lo:501: 00000100:00100000:1.0:1788612379.457402:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002791494a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6500:x1875495932135168:12345-0@lo:501: Request processed in 140us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.457410:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612379.457850:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135168:0@lo:501: 00000100:00100000:2.0:1788612379.457878:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135296:0@lo:503: 00000100:00100000:2.0:1788612379.457943:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.457967:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d7dc3cd going to sleep for 11 seconds 00000100:00100000:0.0:1788612379.457989:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135296 00000100:00100000:0.0:1788612379.457994:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135296 00000100:00100000:0.0:1788612379.458026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612379.458033:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000914b6551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6500:x1875495932135296:12345-0@lo:503: 00000040:00080000:0.0:1788612379.458061:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612379.458105:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000914b6551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6500:x1875495932135296:12345-0@lo:503: Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612379.458112:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612379.458152:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135296:0@lo:503: 00000040:00080000:0.0:1788612379.459035:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788612379.459546:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788612379.459565:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612379.459578:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.459588:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612379.459630:0:6500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788612379.459632:0:6500:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612c7237000 10000000:01000000:2.0:1788612379.459635:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612c7237000 10000000:01000000:2.0:1788612379.459640:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612379.459645:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612c7237000 from 1 10000000:01000000:2.0:1788612379.459647:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612379.459671:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.459678:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.459685:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612379.459700:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135424:0@lo:101: 00000100:00100000:2.0:1788612379.459742:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.459783:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce635557 going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.459942:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135424 00000100:00100000:3.0:1788612379.459948:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135424 00000100:00100000:3.0:1788612379.459987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612379.459993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab257f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6500:x1875495932135424:12345-0@lo:101: 00010000:00010000:3.0:1788612379.460003:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612379.460015:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7b83 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.460033:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.460042:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.460049:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027ccc2c7, rc 0) 00000100:00100000:3.0:1788612379.460086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab257f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932135424:12345-0@lo:101: Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.460092:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612379.460182:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135424:0@lo:101: 00010000:00010000:2.0:1788612379.460193:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.460200:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612379.460237:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135552:0@lo:501: 00000100:00100000:2.0:1788612379.460258:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.460278:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce635557 going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.460321:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135552 00000100:00100000:1.0:1788612379.460325:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135552 00000100:00100000:1.0:1788612379.460353:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612379.460359:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049a5db77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932135552:12345-0@lo:501: 00000100:00100000:1.0:1788612379.460454:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049a5db77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932135552:12345-0@lo:501: Request processed in 95us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.460460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612379.460547:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135552:0@lo:501: 00000100:00100000:2.0:1788612379.460569:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135680:0@lo:503: 00000100:00100000:2.0:1788612379.460600:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.460624:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce635557 going to sleep for 11 seconds 00000100:00100000:1.0:1788612379.460707:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135680 00000100:00100000:1.0:1788612379.460710:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135680 00000100:00100000:1.0:1788612379.460737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612379.460742:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c14a03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932135680:12345-0@lo:503: 00000100:00100000:1.0:1788612379.460821:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c14a03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932135680:12345-0@lo:503: Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612379.460827:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612379.461064:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932135680:0@lo:503: 00000100:00100000:1.0:1788612379.461372:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009557a5d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6550:1875495932135808:0@lo:502: 00000100:00100000:1.0:1788612379.461403:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612379.461425:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e6e3e6d going to sleep for 11 seconds 00000100:00100000:2.0:1788612379.461700:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135808 00000100:00100000:2.0:1788612379.461705:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135808 00000100:00100000:2.0:1788612379.461734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612379.461740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ca11535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6550:x1875495932135808:12345-0@lo:502: 00000100:00100000:2.0:1788612379.461929:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ca11535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6550:x1875495932135808:12345-0@lo:502: Request processed in 189us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612379.461935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612379.462004:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009557a5d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6550:1875495932135808:0@lo:502: 00000020:01000004:1.0:1788612379.462052:0:6550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788612379.462066:0:6550:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006d57088b) 00000020:00000080:1.0:1788612379.462081:0:6550:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788612379.462169:0:6550:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006908d39a from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788612379.462172:0:6550:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006908d39a from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788612379.462175:0:6550:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006908d39a 4 00010000:00080000:1.0:1788612379.462199:0:6550:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052803740@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612379.473993:0:6550:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788612379.474184:0:6550:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788612379.474226:0:6550:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612379.474239:0:6550:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1f8616bf0bc7b98 00000100:00080000:2.0:1788612379.474250:0:6550:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612379.474260:0:6550:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052803740 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612379.474295:0:6550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008f89acfd x1875495932135936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612379.474321:0:6550:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788612379.476961:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932135936:0@lo:38: 00000100:00100000:1.0:1788612379.477035:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612379.479459:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6550:1875495932136064:0@lo:502: 00000100:00100000:3.0:1788612379.479558:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612379.479591:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136064 00000100:00100000:3.0:1788612379.479598:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136064 00000100:00100000:3.0:1788612379.479632:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612379.479639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b35f1e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6550:x1875495932136064:12345-0@lo:502: 00000100:00100000:3.0:1788612379.479744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b35f1e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6550:x1875495932136064:12345-0@lo:502: Request processed in 105us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.479771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612379.479817:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a1aea98 going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.479837:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:6550:1875495932136064:0@lo:502: 00000040:00080000:3.0:1788612379.479876:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788612379.481079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932135936 00000100:00100000:2.0:1788612379.481088:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932135936 00000100:00100000:2.0:1788612379.481124:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612379.481129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009557a5d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932135936:12345-0@lo:38: 00000100:00100000:2.0:1788612379.481194:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009557a5d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932135936:12345-0@lo:38: Request processed in 63us (4159us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788612379.481200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1788612379.481221:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788612379.481244:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612379.481258:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612379.481268:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788612379.481314:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788612379.481316:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612379.481318:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612379.481318:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612379.481320:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612379.481321:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612379.481322:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612379.481324:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612379.481325:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612379.481326:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612379.481328:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612379.481329:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612379.481332:0:6500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788612379.481339:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612379.481340:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612379.481341:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612379.481342:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612379.481343:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612379.481344:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612379.481345:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612379.481345:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612379.481346:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612379.481347:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612379.481348:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612379.481349:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612379.481365:0:6500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788612379.481375:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbe37017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932136192:0@lo:253: 00000100:00100000:2.0:1788612379.481404:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612379.481425:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d7dc3cd going to sleep for 11 seconds 00000100:00100000:2.0:1788612379.481454:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612379.481461:0:3647:0:(import.c:65:import_set_state_nolock()) 0000000052803740 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612379.481465:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788612379.481468:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f89acfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932135936:0@lo:38: 00000100:00100000:2.0:1788612379.481515:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136192 00000100:00100000:2.0:1788612379.481519:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136192 00000100:00100000:2.0:1788612379.481542:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612379.481548:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de8cee0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932136192:12345-0@lo:253: 20000000:01000000:2.0:1788612379.481574:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788612379.481584:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788612379.489258:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788612379.489279:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788612379.491186:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de8cee0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6500:x1875495932136192:12345-0@lo:253: Request processed in 9633us (9775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612379.491201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612379.491265:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbe37017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:6500:1875495932136192:0@lo:253: 10000000:01000000:2.0:1788612379.491293:0:6500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788612379.491296:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612379.491297:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612379.491298:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612379.491299:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612379.491301:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612379.491302:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612379.491303:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612379.491304:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612379.491306:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612379.491307:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612379.491308:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612379.491309:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612379.491325:0:6500:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788612379.492869:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612379.492876:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612379.492897:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.492921:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.492929:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.492965:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.492981:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 11 pid: 6517 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612379.492992:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932136320:0@lo:104: 00000100:00100000:3.0:1788612379.493038:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612379.493083:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a1aea98 going to sleep for 11 seconds 00000100:00100000:3.0:1788612379.493108:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136320 00000100:00100000:3.0:1788612379.493113:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136320 00000100:00100000:3.0:1788612379.493150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612379.493157:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19acd31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932136320:12345-0@lo:104: 00010000:00010000:3.0:1788612379.493168:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.493221:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612379.493226:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19acd31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932136320:12345-0@lo:104: Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.493232:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788612379.493251:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612379.493256:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.493262:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008032095c already unused, calling callback (0000000008ae653f) 10000000:00010000:3.0:1788612379.493265:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.493273:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612379.493279:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612379.493285:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612379.493308:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.493314:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612379.493326:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.493332:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000008032095c/0x1f8616bf0bc7b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.493356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612379.493358:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612379.493359:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612379.493376:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932136320:0@lo:104: 00010000:00010000:3.0:1788612379.493388:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612379.494043:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c54b3e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932136448:0@lo:103: 00000100:00100000:1.0:1788612379.494076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612379.495801:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136448 00000100:00100000:3.0:1788612379.495813:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136448 00010000:00010000:3.0:1788612379.495844:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 12 pid: 6517 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612379.495887:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612379.495896:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e32eeff2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3649:x1875495932136448:12345-0@lo:103: 00010000:00010000:3.0:1788612379.495918:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612379.495923:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 12 pid: 6517 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.495938:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 12 pid: 6517 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.495952:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb931501/0x1f8616bf0bc7b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7b67 expref: 12 pid: 6517 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.495970:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.495978:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612379.496005:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003129996s 00010000:00010000:3.0:1788612379.496009:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496015:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496020:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496026:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496031:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a85738c7 already unused, calling callback (00000000d11f7c87) 00010000:00010000:3.0:1788612379.496034:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496040:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496055:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496064:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612379.496119:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e32eeff2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:3649:x1875495932136448:12345-0@lo:103: Request processed in 225us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612379.496126:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612379.496163:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c54b3e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932136448:0@lo:103: 00010000:00010000:3.0:1788612379.496185:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496199:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612379.496205:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7b9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788612379.513192:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.513438:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788612379.513986:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.514117:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788612379.514286:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.514415:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788612379.515313:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.515445:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788612379.515821:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.516026:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788612379.516206:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788612379.516365:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788612379.522698:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788612379.541241:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788612379.541618:0:6556:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788612379.543322:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788612379.543420:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788612379.545707:0:6500:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788612379.545733:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788612379.545960:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788612379.547254:0:6555:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788612379.547260:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788612379.549435:0:6556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612379.551716:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788612379.553772:0:6556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788612379.553829:0:6556:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788612379.553833:0:6556:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788612379.558237:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788612379.558306:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788612379.558903:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788612379.559144:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788612379.560421:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788612379.560998:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788612379.561148:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788612379.561288:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788612379.561432:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788612379.563941:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788612379.564112:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788612379.564234:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788612379.564348:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788612379.564468:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788612379.564888:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788612379.565210:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788612379.565351:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788612379.566072:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788612379.566225:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788612379.566371:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788612379.567114:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788612379.567430:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788612379.568019:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788612379.568134:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788612379.568262:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788612379.568421:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788612379.568938:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788612379.569073:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788612379.569197:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788612379.569345:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788612379.572665:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788612379.573094:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788612379.573233:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788612379.573404:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788612379.574042:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788612379.574177:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788612379.574407:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788612379.581197:0:6500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788612379.581235:0:6500:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9b941c4f988 00100000:10000000:2.0:1788612379.581243:0:6500:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788612379.584214:0:6500:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788612379.584231:0:6500:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788612379.584250:0:6500:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788612379.584266:0:6500:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788612379.588527:0:6500:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612379.588706:0:6500:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788612379.954131:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612380.977217:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612382.000627:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612383.028197:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612384.049669:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612384.756680:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612384.756690:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612384.756692:0:484:0:(import.c:65:import_set_state_nolock()) 0000000052803740 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612384.756704:0:484:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000052803740 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612384.756726:0:484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c7355b8d x1875495932136704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612384.756780:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932136704:0@lo:38: 00000100:00100000:3.0:1788612384.756916:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612384.756990:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136704 00000100:00100000:3.0:1788612384.756997:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136704 00000100:00100000:3.0:1788612384.757028:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612384.757034:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016677a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932136704:12345-0@lo:38: 00010000:00080000:3.0:1788612384.757056:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1788612384.757088:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1f8616bf0bc7ba6 00000004:00100000:3.0:1788612384.757141:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612384.757272:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000d6d3b117 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612384.757317:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016677a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875495932136704:12345-0@lo:38: Request processed in 282us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612384.757324:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788612384.757361:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c7355b8d x1875495932136704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788612384.757374:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788612384.757380:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788612384.757383:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612384.757385:0:3647:0:(import.c:65:import_set_state_nolock()) 0000000052803740 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612384.757390:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932136704:0@lo:38: 00000100:00100000:0.0:1788612384.758078:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c54b3e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932136576:0@lo:400: 00000100:00100000:0.0:1788612384.758142:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612384.758232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136576 00000100:00100000:3.0:1788612384.758239:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136576 00000100:00100000:3.0:1788612384.758308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612384.758314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c69b655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:3650:x1875495932136576:12345-0@lo:400: 00000100:00100000:3.0:1788612384.758350:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c69b655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:3650:x1875495932136576:12345-0@lo:400: Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612384.758357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788612384.758618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c54b3e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932136576:0@lo:400: 00010000:00010000:2.0:1788612385.077353:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612385.117983:0:6801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788612386.068718:0:6853:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612386.068921:0:6853:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788612386.100099:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612386.288534:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612386.288543:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c7237000 from 3 10000000:01000000:3.0:1788612386.288547:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612386.288584:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612386.288596:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612386.288618:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612386.288639:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932136832:0@lo:101: 00000100:00100000:3.0:1788612386.288709:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612386.288754:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067dc3ac9 going to sleep for 11 seconds 00000100:00100000:0.0:1788612386.288874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136832 00000100:00100000:0.0:1788612386.288881:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136832 00000100:00100000:0.0:1788612386.288934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612386.288941:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055b35792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:6520:x1875495932136832:12345-0@lo:101: 00010000:00010000:0.0:1788612386.288961:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612386.288972:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612386.288992:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612386.289002:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612386.289009:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000441eabea, rc 0) 00000100:00100000:0.0:1788612386.289051:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055b35792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6520:x1875495932136832:12345-0@lo:101: Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612386.289056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612386.289096:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7355b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932136832:0@lo:101: 00010000:00010000:0.0:1788612386.289107:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612386.289114:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612386.289159:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932136960:0@lo:256: 00000100:00100000:0.0:1788612386.289783:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612386.289809:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4b5e8eb going to sleep for 11 seconds 00000100:00100000:0.0:1788612386.289822:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932136960 00000100:00100000:0.0:1788612386.289826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932136960 00000100:00100000:0.0:1788612386.289850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612386.289856:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fb424a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6520:x1875495932136960:12345-0@lo:256: 20000000:01000000:0.0:1788612386.289887:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612386.289900:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612386.289903:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788612386.289972:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fb424a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:6520:x1875495932136960:12345-0@lo:256: Request processed in 115us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612386.289979:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612386.290011:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932136960:0@lo:256: 10000000:01000000:0.0:1788612386.290047:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612386.290052:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612386.290059:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612387.119650:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612388.144781:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612389.168502:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612389.449629:0:6954:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612389.449778:0:6954:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788612389.872011:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932137088:0@lo:400: 00000100:00100000:1.0:1788612389.872085:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612389.872167:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e66ac96a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932137216:0@lo:400: 00000100:00100000:1.0:1788612389.872195:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612389.872821:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137088 00000100:00100000:1.0:1788612389.872829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137088 00000100:00100000:1.0:1788612389.872884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612389.872892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000971db632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3651:x1875495932137088:12345-0@lo:400: 00000100:00100000:1.0:1788612389.872944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000971db632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3651:x1875495932137088:12345-0@lo:400: Request processed in 52us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612389.872964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612389.873007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137216 00000100:00100000:1.0:1788612389.873011:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137216 00000100:00100000:1.0:1788612389.873038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612389.873044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000005ec98f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932137216:12345-0@lo:400: 00000100:00100000:1.0:1788612389.873081:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000005ec98f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932137216:12345-0@lo:400: Request processed in 37us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612389.873087:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788612389.873305:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e66ac96a x1875495932137216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612389.873319:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e66ac96a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932137216:0@lo:400: 00000100:00100000:1.0:1788612389.873353:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932137088:0@lo:400: 00010000:00010000:2.0:1788612390.196989:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612391.215817:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612392.250316:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612393.281403:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612394.288863:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612394.991701:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932137344:0@lo:400: 00000100:00100000:1.0:1788612394.991774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612394.991849:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e66ac96a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932137472:0@lo:400: 00000100:00100000:1.0:1788612394.991881:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612394.991917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137344 00000100:00100000:1.0:1788612394.991925:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137344 00000100:00100000:1.0:1788612394.991967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612394.991974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e690430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3649:x1875495932137344:12345-0@lo:400: 00000100:00100000:1.0:1788612394.992020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e690430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3649:x1875495932137344:12345-0@lo:400: Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612394.992028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612394.992072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137472 00000100:00100000:1.0:1788612394.992076:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137472 00000100:00100000:1.0:1788612394.992101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612394.992106:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b082719e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932137472:12345-0@lo:400: 00000100:00100000:1.0:1788612394.992147:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b082719e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932137472:12345-0@lo:400: Request processed in 41us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612394.992154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788612394.992761:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e66ac96a x1875495932137472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612394.992962:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e66ac96a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932137472:0@lo:400: 00000100:00100000:1.0:1788612394.993413:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932137344:0@lo:400: 00010000:00010000:1.0:1788612395.311664:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612396.368582:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612397.424418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612398.448627:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612399.478192:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612400.114965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e66ac96a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932137728:0@lo:400: 00000100:00100000:1.0:1788612400.115046:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.115113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137728 00000100:00100000:1.0:1788612400.115120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137728 00000100:00100000:3.0:1788612400.115251:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932137600:0@lo:400: 00000100:00100000:3.0:1788612400.115285:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.115341:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612400.115350:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d527323 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932137728:12345-0@lo:400: 00000100:00100000:1.0:1788612400.115407:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d527323 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932137728:12345-0@lo:400: Request processed in 59us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.115414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612400.115438:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137600 00000100:00100000:1.0:1788612400.115441:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137600 00000100:00100000:1.0:1788612400.115500:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612400.115506:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062c78b59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3651:x1875495932137600:12345-0@lo:400: 00000100:00100000:1.0:1788612400.115543:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062c78b59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3651:x1875495932137600:12345-0@lo:400: Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.115549:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788612400.115678:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e66ac96a x1875495932137728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612400.115692:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e66ac96a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932137728:0@lo:400: 00000100:00100000:1.0:1788612400.116305:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932137600:0@lo:400: 00010000:00010000:1.0:1788612400.497419:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788612400.682860:0:7453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612400.682865:0:7453:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788612400.682866:0:7453:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788612400.683003:0:7453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f44019ba 00000020:01000004:1.0:1788612400.683017:0:7453:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788612400.683027:0:7453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788612400.683038:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000977e6eee) 00000020:00000080:1.0:1788612400.683051:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788612400.768465:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788612400.769364:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788612400.808345:0:7453:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788612400.809922:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788612400.809933:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788612400.809945:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc7bc2 00000020:01000004:1.0:1788612400.809951:0:7453:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788612400.809970:0:7453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788612400.809973:0:7453:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788612400.809978:0:7453:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788612400.810002:0:7453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788612400.810005:0:7453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788612400.879802:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788612400.879929:0:7453:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788612400.879933:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788612400.879935:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612400.879936:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612400.879941:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612400.879942:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612400.879944:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612400.879944:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612400.879946:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612400.879947:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612400.879948:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612400.879949:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612400.879952:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788612400.879955:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612400.879956:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612400.879957:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612400.879958:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612400.879959:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612400.879960:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612400.879960:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612400.879961:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612400.879962:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612400.879963:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612400.879963:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612400.879987:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788612400.880003:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbe37017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932137856:0@lo:253: 00000100:00100000:2.0:1788612400.880066:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612400.880112:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b4abbfd going to sleep for 11 seconds 00000100:00100000:1.0:1788612400.880163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137856 00000100:00100000:1.0:1788612400.880171:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137856 00000100:00100000:1.0:1788612400.880222:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612400.880236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c232a180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932137856:12345-0@lo:253: 20000000:01000000:1.0:1788612400.880274:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788612400.880278:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788612400.880283:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788612400.880285:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788612400.880316:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788612400.881381:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612400.881801:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788612400.881829:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788612400.881846:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788612400.881861:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788612400.881874:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788612400.881937:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788612400.881947:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788612400.881961:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788612400.881966:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788612400.881978:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788612400.881983:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788612400.881996:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788612400.882022:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788612400.882132:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788612400.882141:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:0.0:1788612400.882155:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788612400.882161:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788612400.882175:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788612400.882180:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:0.0:1788612400.882191:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788612400.882196:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788612400.882208:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788612400.882221:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788612400.882230:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788612400.882298:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788612400.882306:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788612400.882317:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788612400.882332:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788612400.882346:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788612400.882351:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788612400.882362:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788612400.882377:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788612400.882382:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788612400.882398:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788612400.882404:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788612400.889448:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788612400.890088:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788612400.890115:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:0.0:1788612400.890118:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:0.0:1788612400.890133:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788612400.890138:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788612400.890149:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788612400.890155:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:0.0:1788612400.890183:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788612400.890192:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788612400.890206:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788612400.890221:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788612400.890698:0:6516:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788612400.890707:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788612400.891150:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788612400.891323:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788612400.891340:0:6516:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:1.0:1788612400.891342:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1788612400.891354:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788612400.891360:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788612400.891371:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788612400.891376:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1788612400.891386:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788612400.891391:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788612400.891401:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788612400.891413:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788612400.891443:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788612400.891446:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788612400.891449:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788612400.891517:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788612400.891518:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612400.892321:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788612400.892347:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788612400.892360:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788612400.892655:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788612400.892677:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788612400.892691:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788612400.892701:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788612400.892703:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788612400.893039:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788612400.893057:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788612400.893070:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788612400.893198:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788612400.893217:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788612400.893232:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788612400.893241:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788612400.893242:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612400.893466:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788612400.893831:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788612400.893850:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788612400.894024:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788612400.894043:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788612400.894065:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788612400.894078:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788612400.894081:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788612400.894085:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788612400.894090:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788612400.898328:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788612400.898512:0:6516:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788612400.927833:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788612400.928847:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.928867:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.928874:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.928880:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.928886:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.928940:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.928955:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 12 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612400.928967:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932137984:0@lo:104: 00000100:00100000:0.0:1788612400.929026:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612400.929081:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.929088:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 12 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612400.929095:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003834a439 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932138112:0@lo:104: 00000100:00100000:0.0:1788612400.929116:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612400.929136:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.929144:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 12 pid: 6517 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612400.929151:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034522868 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932138240:0@lo:104: 00000100:00100000:0.0:1788612400.929182:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612400.929192:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c0617e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788612400.929255:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932137984 00000100:00100000:1.0:1788612400.929262:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932137984 00000100:00100000:1.0:1788612400.929295:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138112 00000100:00100000:1.0:1788612400.929297:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138112 00000100:00100000:1.0:1788612400.929306:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138240 00000100:00100000:1.0:1788612400.929308:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138240 00000100:00100000:1.0:1788612400.929319:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612400.929326:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084082c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6516:x1875495932137984:12345-0@lo:104: 00010000:00010000:1.0:1788612400.929337:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.929393:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612400.929397:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084082c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6516:x1875495932137984:12345-0@lo:104: Request processed in 72us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.929404:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612400.929417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612400.929422:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ca24aa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6516:x1875495932138112:12345-0@lo:104: 00010000:00010000:1.0:1788612400.929429:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.929468:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612400.929473:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ca24aa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6516:x1875495932138112:12345-0@lo:104: Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.929507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612400.929519:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612400.929524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b40d31a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932138240:12345-0@lo:104: 00010000:00010000:1.0:1788612400.929530:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.929555:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788612400.929559:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b40d31a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932138240:12345-0@lo:104: Request processed in 36us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.929564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788612400.931177:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788612400.931186:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931196:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000869fc3ec already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612400.931199:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931207:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612400.931213:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612400.931218:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612400.931271:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931278:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612400.931296:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931302:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000869fc3ec/0x1f8616bf0bc7b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931317:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612400.931320:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931330:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f15d75e already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612400.931332:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931338:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612400.931343:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612400.931348:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612400.931360:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931365:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612400.931378:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931396:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000005f15d75e/0x1f8616bf0bc7b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b1a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931406:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612400.931408:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931413:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046da2287 already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612400.931415:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931420:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612400.931426:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612400.931431:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612400.931443:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931448:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612400.931452:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931458:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 0000000046da2287/0x1f8616bf0bc7af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7afe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.931469:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612400.931489:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612400.931491:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612400.931496:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612400.931516:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932138368:0@lo:103: 00000100:00100000:1.0:1788612400.931566:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.932804:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000181c9819 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932138496:0@lo:103: 00000100:00100000:1.0:1788612400.932848:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.932870:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612400.932875:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0eaba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932138624:0@lo:103: 00000100:00100000:1.0:1788612400.932896:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.932935:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138368 00000100:00100000:1.0:1788612400.932942:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138368 00010000:00010000:1.0:1788612400.932967:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 13 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612400.932987:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138496 00000100:00100000:1.0:1788612400.932989:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138496 00010000:00010000:1.0:1788612400.932997:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612400.933006:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138624 00000100:00100000:1.0:1788612400.933008:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138624 00010000:00010000:1.0:1788612400.933018:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 15 pid: 6517 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612400.933032:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612400.933039:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031771f79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3649:x1875495932138368:12345-0@lo:103: 00010000:00010000:1.0:1788612400.933050:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612400.933054:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 15 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.933078:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 15 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.933094:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612400.933126:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031771f79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3649:x1875495932138368:12345-0@lo:103: Request processed in 88us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.933133:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788612400.933697:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000027ccc2c7/0x1f8616bf0bc7b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7b83 expref: 14 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612400.933712:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932137984:0@lo:104: 00000100:00100000:0.0:1788612400.933733:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003834a439 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932138112:0@lo:104: 00000100:00100000:0.0:1788612400.933742:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034522868 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932138240:0@lo:104: 00010000:00010000:0.0:1788612400.933773:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612400.934304:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612400.934317:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d73e57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:3650:x1875495932138496:12345-0@lo:103: 00010000:00010000:1.0:1788612400.934329:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612400.934334:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 13 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.934343:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 13 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.934353:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0b4bfc3/0x1f8616bf0bc7b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7b13 expref: 13 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.934364:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612400.934411:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d73e57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3650:x1875495932138496:12345-0@lo:103: Request processed in 98us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612400.934456:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000181c9819 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932138496:0@lo:103: 00000100:00100000:0.0:1788612400.934513:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788612400.934522:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788612400.935878:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612400.935894:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035919e74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3650:x1875495932138624:12345-0@lo:103: 00010000:00010000:3.0:1788612400.935906:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612400.935912:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 12 pid: 6517 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935925:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 12 pid: 6517 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935937:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068802405/0x1f8616bf0bc7afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7af7 expref: 12 pid: 6517 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935952:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935971:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935985:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935991:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.935997:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.936003:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.936010:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e37b206c already unused, calling callback (00000000d11f7c87) 00010000:00010000:3.0:1788612400.936013:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.936019:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.936045:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.936055:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612400.936111:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035919e74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:3650:x1875495932138624:12345-0@lo:103: Request processed in 224us (3215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612400.936118:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612400.939347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0eaba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932138624:0@lo:103: 00010000:00010000:2.0:1788612400.943258:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612400.943280:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612400.943287:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7bc9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788612400.943316:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788612400.945917:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612400.946037:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932138368:0@lo:103: 00000100:00100000:3.0:1788612400.946446:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c232a180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:7453:x1875495932137856:12345-0@lo:253: Request processed in 66210us (66379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612400.946457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612400.946813:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbe37017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932137856:0@lo:253: 10000000:01000000:2.0:1788612400.946827:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788612400.946840:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612400.946842:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612400.946844:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612400.946844:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788612400.946845:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612400.946846:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612400.946847:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612400.946849:0:7453:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788612400.946850:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612400.946851:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788612400.946867:0:7453:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f44019ba from lustre-MDT0001 10000000:01000000:2.0:1788612400.946888:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788612400.946890:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788612400.946897:0:7453:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9612d1e64d40 local copy 10000000:01000000:2.0:1788612400.946900:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788612400.946933:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612400.946943:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612400.946952:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612400.946968:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbe37017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932138752:0@lo:101: 00000100:00100000:2.0:1788612400.947001:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612400.947039:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c221faaf going to sleep for 11 seconds 00000100:00100000:1.0:1788612400.947387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138752 00000100:00100000:1.0:1788612400.947394:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138752 00000100:00100000:1.0:1788612400.947432:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788612400.947439:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cfd378f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:7453:x1875495932138752:12345-0@lo:101: 00010000:00010000:1.0:1788612400.947454:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612400.947466:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d97f0138/0x1f8616bf0bc7bd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7bd0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.947524:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d97f0138/0x1f8616bf0bc7bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bd0 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.947534:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d97f0138/0x1f8616bf0bc7bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bd0 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.947543:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d97f0138, rc 0) 00000100:00100000:3.0:1788612400.947666:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbe37017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932138752:0@lo:101: 00010000:00010000:3.0:1788612400.947678:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.947686:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612400.947779:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d75bb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932138880:0@lo:501: 00000100:00100000:3.0:1788612400.952532:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612400.952699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932138880 00000100:00100000:3.0:1788612400.952709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932138880 00000100:00100000:3.0:1788612400.952850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612400.952860:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa69fb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:7453:x1875495932138880:12345-0@lo:501: 00000100:00100000:3.0:1788612400.952956:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa69fb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:7453:x1875495932138880:12345-0@lo:501: Request processed in 98us (432us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612400.952964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612400.953043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cfd378f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+10:7453:x1875495932138752:12345-0@lo:101: Request processed in 5604us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.953051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612400.956349:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef6283b7 going to sleep for 11 seconds 00000100:00100000:3.0:1788612400.956392:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d75bb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932138880:0@lo:501: 10000000:01000000:3.0:1788612400.956416:0:7453:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788612400.956454:0:7453:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788612400.956462:0:7453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.956471:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.956905:0:7453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.957050:0:7453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788612400.957081:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612fccf8000 10000000:01000000:3.0:1788612400.957087:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788612400.957092:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9612d1e64d40 10000000:01000000:3.0:1788612400.957094:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788612400.957098:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9612d1e64d40 from 1 10000000:01000000:3.0:1788612400.957100:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788612400.957132:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.957140:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.957149:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612400.961919:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d75bb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139008:0@lo:101: 00000100:00100000:2.0:1788612400.961989:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612400.962033:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002dfd7ba going to sleep for 11 seconds 00000100:00100000:3.0:1788612400.962141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139008 00000100:00100000:3.0:1788612400.962149:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139008 00000100:00100000:3.0:1788612400.962313:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612400.962321:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005315bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+10:7453:x1875495932139008:12345-0@lo:101: 00010000:00010000:3.0:1788612400.962335:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612400.962352:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f01a4e3/0x1f8616bf0bc7be5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7bde expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.962376:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f01a4e3/0x1f8616bf0bc7be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bde expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.962405:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f01a4e3/0x1f8616bf0bc7be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bde expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.962414:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f01a4e3, rc 0) 00000100:00100000:3.0:1788612400.962467:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005315bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:7453:x1875495932139008:12345-0@lo:101: Request processed in 147us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612400.962500:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612400.962719:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d75bb2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139008:0@lo:101: 00010000:00010000:0.0:1788612400.962734:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.962743:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612400.962777:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788612400.962795:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.962802:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000004bfe839f/0x1f8616bf0bc7bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612400.962814:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9612fccf8000 10000000:01000000:0.0:1788612400.962819:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788612400.962822:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9612fccf8000 from 1 10000000:01000000:0.0:1788612400.962825:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788612400.962847:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.962865:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.962873:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612400.962886:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034522868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139136:0@lo:101: 00000100:00100000:0.0:1788612400.962918:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612400.962941:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ea2f9f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788612400.963117:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139136 00000100:00100000:3.0:1788612400.963122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139136 00000100:00100000:3.0:1788612400.963164:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612400.963313:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efe1c95f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:7453:x1875495932139136:12345-0@lo:101: 00010000:00010000:3.0:1788612400.963322:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612400.963330:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f3e9d415/0x1f8616bf0bc7bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7bec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.963345:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3e9d415/0x1f8616bf0bc7bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bec expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.963352:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f3e9d415/0x1f8616bf0bc7bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bec expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612400.963358:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f3e9d415, rc 0) 00000100:00100000:3.0:1788612400.963396:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efe1c95f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139136:12345-0@lo:101: Request processed in 85us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612400.963436:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034522868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139136:0@lo:101: 00010000:00010000:0.0:1788612400.963446:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.963452:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612400.963464:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788612400.963471:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.963498:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000000919421e/0x1f8616bf0bc7bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612400.963504:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788612400.963517:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612400.963522:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9612fccf8000 10000000:01000000:0.0:1788612400.963525:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788612400.963528:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788612400.963535:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788612400.963550:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.963556:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.963562:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612400.963583:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034522868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139264:0@lo:101: 00000100:00100000:0.0:1788612400.963610:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612400.963633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139264 00000100:00100000:0.0:1788612400.963636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139264 00010000:00010000:1.0:1788612400.963756:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612400.963778:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.963787:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000031f4735e already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612400.963790:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.963797:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612400.963804:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612400.963810:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788612400.967396:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ea2f9f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788612400.967658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788612400.968036:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.968047:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612400.968080:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.968087:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 0000000031f4735e/0x1f8616bf0bc7bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7bd7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.968102:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612400.968104:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612400.968106:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612400.968139:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612400.968163:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932139392:0@lo:103: 00000100:00100000:2.0:1788612400.968217:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.968347:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139392 00000100:00100000:1.0:1788612400.968355:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139392 00000100:00100000:1.0:1788612400.968399:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612400.968406:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f89acfd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:3649:x1875495932139392:12345-0@lo:103: 00010000:00010000:1.0:1788612400.968418:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612400.968431:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d97f0138/0x1f8616bf0bc7bd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc7bd0 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.968448:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612400.968508:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f89acfd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:3649:x1875495932139392:12345-0@lo:103: Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612400.968515:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612400.968545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932139392:0@lo:103: 00000100:00100000:0.0:1788612400.968901:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612400.968911:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f95b5380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+11:7453:x1875495932139264:12345-0@lo:101: 00010000:00010000:0.0:1788612400.968923:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612400.968936:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000bc02cd2/0x1f8616bf0bc7c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7bfa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.968954:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000bc02cd2/0x1f8616bf0bc7c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.968963:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000bc02cd2/0x1f8616bf0bc7c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612400.968971:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000bc02cd2, rc 0) 00000100:00100000:0.0:1788612400.969011:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f95b5380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139264:12345-0@lo:101: Request processed in 103us (5400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612400.969016:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612400.969081:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034522868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139264:0@lo:101: 00010000:00010000:1.0:1788612400.969096:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612400.969114:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612400.969220:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139520:0@lo:501: 00000100:00100000:1.0:1788612400.969247:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.984893:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6bd2b73 going to sleep for 11 seconds 00000100:00100000:2.0:1788612400.991266:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139520 00000100:00100000:2.0:1788612400.991282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139520 00000100:00100000:2.0:1788612400.991356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612400.991366:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d331e0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139520:12345-0@lo:501: 00000100:00100000:2.0:1788612400.991554:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d331e0cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139520:12345-0@lo:501: Request processed in 190us (22305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612400.991562:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612400.991686:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139520:0@lo:501: 00000100:00100000:1.0:1788612400.991723:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139648:0@lo:503: 00000100:00100000:1.0:1788612400.991778:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.991800:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6bd2b73 going to sleep for 11 seconds 00000100:00100000:2.0:1788612400.991854:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139648 00000100:00100000:2.0:1788612400.991858:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139648 00000100:00100000:2.0:1788612400.991874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788612400.991879:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054a16fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139648:12345-0@lo:503: 00000100:00100000:2.0:1788612400.991993:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054a16fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139648:12345-0@lo:503: Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612400.991999:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612400.994620:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139648:0@lo:503: 00000040:00080000:1.0:1788612400.997088:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612400.997280:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139776:0@lo:502: 00000100:00100000:1.0:1788612400.997353:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.997416:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6bd2b73 going to sleep for 11 seconds 00000100:00100000:3.0:1788612400.997651:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139776 00000100:00100000:3.0:1788612400.997658:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139776 00000100:00100000:3.0:1788612400.997705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612400.997721:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b37115a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139776:12345-0@lo:502: 00000100:00100000:3.0:1788612400.997852:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b37115a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139776:12345-0@lo:502: Request processed in 133us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612400.997860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612400.998255:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139776:0@lo:502: 00000040:00080000:1.0:1788612400.998455:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788612400.998519:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788612400.998535:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788612400.998548:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788612400.998560:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788612400.998635:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788612400.998654:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788612400.998667:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788612400.998679:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788612400.998690:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788612400.998712:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788612400.998725:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788612400.998738:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788612400.998750:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788612400.998930:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788612400.998948:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788612400.998962:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788612400.998973:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788612400.998984:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788612400.998998:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788612400.999010:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788612400.999023:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788612400.999035:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788612400.999060:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139904:0@lo:502: 00000100:00100000:1.0:1788612400.999110:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612400.999147:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6bd2b73 going to sleep for 11 seconds 00000100:00100000:3.0:1788612400.999256:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932139904 00000100:00100000:3.0:1788612400.999262:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932139904 00000100:00100000:3.0:1788612400.999301:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612400.999309:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f16d70ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139904:12345-0@lo:502: 00000100:00100000:3.0:1788612400.999388:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f16d70ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932139904:12345-0@lo:502: Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612400.999396:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612400.999504:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932139904:0@lo:502: 00000040:00080000:1.0:1788612400.999546:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788612400.999553:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788612401.000013:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612401.000023:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612401.000026:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788612401.000030:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788612401.000033:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612401.000056:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a3648683) 00000020:00000080:1.0:1788612401.000073:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788612401.000079:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788612401.000150:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788612401.000225:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc7c0f 00000020:00000080:1.0:1788612401.000424:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788612401.000428:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612401.000436:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612401.000437:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788612401.000441:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612401.000444:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612401.000445:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788612401.000448:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612401.000455:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000f647f743) 00000020:00000080:1.0:1788612401.000465:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788612401.000469:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788612401.000470:0:7466:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788612401.000472:0:7466:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788612401.000514:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788612401.000557:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f44019ba from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788612401.000567:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000072c60759) 00000020:00000080:3.0:1788612401.001148:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788612401.001274:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788612401.001281:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7c24 00000020:00000080:3.0:1788612401.001399:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788612401.001406:0:7466:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788612401.001411:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1f8616bf0bc7c2b 00080000:01000000:3.0:1788612401.001417:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788612401.001421:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc7c32 00080000:10000000:3.0:1788612401.002997:0:7466:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788612401.003836:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788612401.103579:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788612401.103818:0:7466:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788612401.107010:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788612401.111105:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788612401.129065:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788612401.129078:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612401.129085:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612401.129088:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788612401.129091:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612401.129096:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612401.129098:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788612401.129101:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612401.129106:0:7466:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:3.0:1788612401.129142:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612401.129158:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000594af61b) 00000020:00000080:3.0:1788612401.129178:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788612401.129183:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612401.129274:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788612401.129281:0:7466:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788612401.129288:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc7c40 00010000:00080000:3.0:1788612401.129317:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a3fe177e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612401.130934:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788612401.137871:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788612401.137886:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788612401.137926:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788612401.137948:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7c47 00000100:00080000:1.0:1788612401.137958:0:7466:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612401.137964:0:7466:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a3fe177e using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612401.137998:0:7466:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000006ecb08b x1875495932140032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612401.138027:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788612401.138093:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932140160:0@lo:400: 00000100:00100000:1.0:1788612401.138151:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.138741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932140032:0@lo:38: 00000100:00100000:0.0:1788612401.138793:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.138897:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140032 00000100:00100000:2.0:1788612401.138905:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140032 00000100:00100000:2.0:1788612401.138944:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612401.138950:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003834a439 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932140032:12345-0@lo:38: 00010000:00080000:2.0:1788612401.138973:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1788612401.139002:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7c4e 00000004:00100000:2.0:1788612401.139016:0:6528:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788612401.139021:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788612401.139122:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140160 00000100:00100000:1.0:1788612401.139126:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140160 00000100:00100000:1.0:1788612401.139167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612401.139174:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c074f91 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932140160:12345-0@lo:400: 00000100:00100000:1.0:1788612401.140385:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c074f91 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932140160:12345-0@lo:400: Request processed in 1209us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.140408:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:2.0:1788612401.141310:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612401.141318:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.141320:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788612401.141324:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788612401.141326:0:7466:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788612401.141328:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612401.141336:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612401.141337:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788612401.141340:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.141341:0:7466:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788612401.141343:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612401.141348:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.141349:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788612401.141354:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788612401.141414:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788612401.141435:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612401.141438:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.141439:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788612401.141442:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612401.141444:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.141445:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612401.141448:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612401.141449:0:7466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612401.141473:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612401.141496:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.141497:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788612401.141500:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788612401.142377:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788612401.142406:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788612401.142433:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.142444:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000068802405/0x1f8616bf0bc7bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612401.142452:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612fccf8000 from 1 10000000:01000000:0.0:1788612401.142455:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612401.142515:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.142523:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.142532:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612401.142552:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140288:0@lo:101: 00000100:00100000:0.0:1788612401.142625:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.142657:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029641d0f going to sleep for 11 seconds 00010000:00080000:0.0:1788612401.142698:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e7af02b4 x1875495932140160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612401.142723:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932140160:0@lo:400: 00000100:00100000:3.0:1788612401.143704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140288 00000100:00100000:3.0:1788612401.143712:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140288 00000100:00100000:3.0:1788612401.143753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612401.143768:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aa7e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+12:7453:x1875495932140288:12345-0@lo:101: 00010000:00010000:3.0:1788612401.143781:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612401.143793:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7c55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.143815:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.143825:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.143832:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000207b0f89, rc 0) 00000100:00100000:3.0:1788612401.143885:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aa7e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:7453:x1875495932140288:12345-0@lo:101: Request processed in 125us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.143892:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612401.144513:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140288:0@lo:101: 00010000:00010000:0.0:1788612401.144531:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.144539:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612401.145072:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140416:0@lo:256: 00000100:00100000:0.0:1788612401.145124:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.145151:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029641d0f going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.145316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140416 00000100:00100000:1.0:1788612401.145322:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140416 00000100:00100000:1.0:1788612401.145355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612401.145362:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000070e5e80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:7453:x1875495932140416:12345-0@lo:256: 20000000:01000000:1.0:1788612401.145377:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788612401.145392:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788612401.145395:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788612401.145513:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000070e5e80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:7453:x1875495932140416:12345-0@lo:256: Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.145520:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788612401.146362:0:6528:0:(import.c:65:import_set_state_nolock()) 0000000017f6f256 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612401.146422:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003834a439 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932140032:12345-0@lo:38: Request processed in 7470us (7628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.146435:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612401.146587:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612401.146595:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788612401.146602:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788612401.146607:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788612401.146609:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000a3fe177e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788612401.146617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932140032:0@lo:38: 00000100:00100000:0.0:1788612401.146897:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140416:0@lo:256: 10000000:01000000:0.0:1788612401.147703:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612401.147720:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.147731:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612401.147739:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fccf8000 from 1 10000000:01000000:0.0:1788612401.147741:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612401.147776:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.147783:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.148591:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612401.148607:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005be7a172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932140672:0@lo:41: 00000100:00100000:1.0:1788612401.148665:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.148717:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140672 00000100:00100000:1.0:1788612401.148723:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140672 00000100:00100000:1.0:1788612401.148755:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612401.148773:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6a01f9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875495932140672:12345-0@lo:41: 00000004:00000024:1.0:1788612401.148800:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788612401.148840:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6a01f9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875495932140672:12345-0@lo:41: Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.148847:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612401.148882:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005be7a172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932140672:0@lo:41: 00010000:00010000:0.0:1788612401.149172:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.152170:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140544:0@lo:101: 00000100:00100000:1.0:1788612401.152252:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.152295:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041057d61 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.152395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140544 00000100:00100000:3.0:1788612401.152403:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140544 00000100:00100000:3.0:1788612401.152449:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788612401.152468:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c85a4cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:7453:x1875495932140544:12345-0@lo:101: 00010000:00010000:3.0:1788612401.152518:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612401.152534:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7c63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.152560:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.152580:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.152588:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c707eb3, rc 0) 00000100:00100000:3.0:1788612401.152626:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c85a4cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:7453:x1875495932140544:12345-0@lo:101: Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.152632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788612401.152934:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140544:0@lo:101: 00010000:00010000:0.0:1788612401.152949:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.152957:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612401.153070:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140800:0@lo:501: 00000100:00100000:0.0:1788612401.153337:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.153365:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029641d0f going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.153415:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140800 00000100:00100000:3.0:1788612401.153419:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140800 00000100:00100000:3.0:1788612401.153451:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612401.153457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a89ab89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:7453:x1875495932140800:12345-0@lo:501: 00000100:00100000:3.0:1788612401.153646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a89ab89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:7453:x1875495932140800:12345-0@lo:501: Request processed in 189us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.153652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788612401.154618:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140800:0@lo:501: 00000100:00100000:0.0:1788612401.154658:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140928:0@lo:503: 00000100:00100000:0.0:1788612401.154707:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.154757:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029641d0f going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.155090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932140928 00000100:00100000:1.0:1788612401.155097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932140928 00000100:00100000:1.0:1788612401.155136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612401.155143:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e25127e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:7453:x1875495932140928:12345-0@lo:503: 00000040:00080000:1.0:1788612401.155183:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612401.155245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e25127e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:7453:x1875495932140928:12345-0@lo:503: Request processed in 103us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.155252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612401.155374:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932140928:0@lo:503: 00000040:00080000:1.0:1788612401.156467:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612401.156665:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788612401.156748:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612401.157921:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788612401.158062:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788612401.158087:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612401.158108:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.158133:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612401.158183:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788612401.158186:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612fccf8000 10000000:01000000:2.0:1788612401.158189:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612fccf8000 10000000:01000000:2.0:1788612401.158193:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612401.158198:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fccf8000 from 1 10000000:01000000:2.0:1788612401.158201:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612401.158935:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.158946:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.158956:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612401.158976:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141056:0@lo:101: 00000100:00100000:2.0:1788612401.159037:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.159076:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076937afe going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.159151:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141056 00000100:00100000:3.0:1788612401.159157:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141056 00000100:00100000:3.0:1788612401.159243:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612401.159252:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9821b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:7453:x1875495932141056:12345-0@lo:101: 00010000:00010000:3.0:1788612401.159263:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612401.159274:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e96c550/0x1f8616bf0bc7c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7c71 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.159305:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e96c550/0x1f8616bf0bc7c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.159314:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e96c550/0x1f8616bf0bc7c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.159323:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e96c550, rc 0) 00000100:00100000:3.0:1788612401.159365:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9821b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141056:12345-0@lo:101: Request processed in 116us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.159372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612401.159439:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141056:0@lo:101: 00010000:00010000:2.0:1788612401.159452:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.159459:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612401.159597:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141184:0@lo:501: 00000100:00100000:2.0:1788612401.159623:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.159914:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076937afe going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.160008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141184 00000100:00100000:1.0:1788612401.160014:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141184 00000100:00100000:1.0:1788612401.160037:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612401.160043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c78d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141184:12345-0@lo:501: 00000100:00100000:1.0:1788612401.160145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c78d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141184:12345-0@lo:501: Request processed in 102us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.160151:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788612401.160219:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141184:0@lo:501: 00000100:00100000:2.0:1788612401.160246:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141312:0@lo:503: 00000100:00100000:2.0:1788612401.160284:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.160305:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076937afe going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.160393:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141312 00000100:00100000:1.0:1788612401.160398:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141312 00000100:00100000:1.0:1788612401.160416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612401.160420:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053ffbb4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141312:12345-0@lo:503: 00000100:00100000:1.0:1788612401.160526:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053ffbb4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141312:12345-0@lo:503: Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.160537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612401.160671:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141312:0@lo:503: 00000040:00080000:2.0:1788612401.164461:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612401.164677:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141440:0@lo:502: 00000100:00100000:2.0:1788612401.164816:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.164893:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076937afe going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.164962:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141440 00000100:00100000:3.0:1788612401.164969:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141440 00000100:00100000:0.0:1788612401.165068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612401.165079:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1972370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141440:12345-0@lo:502: 00000100:00100000:0.0:1788612401.165186:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1972370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141440:12345-0@lo:502: Request processed in 110us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612401.165193:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788612401.165280:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141440:0@lo:502: 00000040:00080000:2.0:1788612401.165502:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788612401.165528:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788612401.165543:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788612401.165556:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788612401.165584:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788612401.165599:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788612401.165612:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788612401.165625:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788612401.167708:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788612401.167767:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788612401.167783:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788612401.167795:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788612401.167804:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788612401.167830:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788612401.167840:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788612401.167851:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788612401.167877:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788612401.167890:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788612401.167901:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788612401.167911:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788612401.167923:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788612401.167933:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788612401.167945:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788612401.167957:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788612401.167971:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788612401.167983:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788612401.167994:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788612401.168005:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788612401.168042:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141568:0@lo:502: 00000100:00100000:2.0:1788612401.168110:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.169469:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076937afe going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.169521:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141568 00000100:00100000:1.0:1788612401.169528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141568 00000100:00100000:1.0:1788612401.169565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788612401.169626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5f69e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141568:12345-0@lo:502: 00000100:00100000:1.0:1788612401.169792:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5f69e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141568:12345-0@lo:502: Request processed in 168us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.169799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788612401.170081:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bb0b5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141568:0@lo:502: 00000040:00080000:2.0:1788612401.170143:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788612401.170153:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788612401.170747:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788612401.170771:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000059273298) 00000020:00000080:0.0:1788612401.170795:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788612401.171005:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f44019ba from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788612401.171008:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f44019ba from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788612401.171011:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f44019ba 3 00010000:00080000:0.0:1788612401.171034:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002146406f@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612401.181943:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788612401.182198:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788612401.182239:0:7472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612401.182252:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1f8616bf0bc7c86 00000100:00080000:0.0:1788612401.182262:0:7472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612401.182267:0:7472:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000002146406f using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612401.182299:0:7472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b1261073 x1875495932141696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612401.182352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932141696:0@lo:38: 00000100:00100000:2.0:1788612401.182417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612401.182518:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788612401.184607:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141696 00000100:00100000:1.0:1788612401.184621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141696 00000100:00100000:1.0:1788612401.184665:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612401.184672:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bb0b5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932141696:12345-0@lo:38: 00010000:00080000:1.0:1788612401.184698:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1788612401.184730:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1f8616bf0bc7c8d 00000004:00100000:1.0:1788612401.184745:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788612401.184785:0:6523:0:(import.c:65:import_set_state_nolock()) 000000000b29dab5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612401.186339:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bb0b5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875495932141696:12345-0@lo:38: Request processed in 1662us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.186351:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788612401.191710:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b1261073 x1875495932141696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.191726:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612401.191735:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788612401.191743:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788612401.191748:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788612401.191767:0:3647:0:(import.c:65:import_set_state_nolock()) 000000002146406f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788612401.191775:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1261073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932141696:0@lo:38: 00000040:00080000:0.0:1788612401.192099:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788612401.193703:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788612401.193737:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612401.193755:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.193774:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000947773aa/0x1f8616bf0bc7c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788612401.193825:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788612401.193828:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612401.193829:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612401.193831:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612401.193832:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612401.193833:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612401.193835:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612401.193836:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612401.193838:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612401.193839:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612401.193841:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612401.193844:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788612401.193847:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612401.193849:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612401.193850:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612401.193851:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612401.193852:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612401.193853:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612401.193854:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612401.193855:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612401.193856:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612401.193857:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612401.193858:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612401.193881:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788612401.193895:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141824:0@lo:253: 00000100:00100000:2.0:1788612401.193961:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.193997:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b4abbfd going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.194090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141824 00000100:00100000:1.0:1788612401.194097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141824 00000100:00100000:1.0:1788612401.194143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788612401.194150:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001768abee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141824:12345-0@lo:253: 20000000:01000000:1.0:1788612401.194172:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788612401.194184:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788612401.195614:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 40000000:00080000:3.0:1788612401.195742:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 20000000:01000000:1.0:1788612401.195922:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788612401.195956:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788612401.196194:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001768abee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7453:x1875495932141824:12345-0@lo:253: Request processed in 2043us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.196204:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 20000000:01000000:3.0:1788612401.196247:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612401.196251:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612401.196265:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.196277:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.196284:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.196290:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.196315:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.196335:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612401.196346:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ea8cd35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932141952:0@lo:104: 00000100:00100000:3.0:1788612401.196373:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612401.196411:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.196418:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612401.196426:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a822c23d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932142080:0@lo:104: 00000100:00100000:3.0:1788612401.196441:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.196528:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001901e7a going to sleep for 11 seconds 00000100:00100000:2.0:1788612401.196647:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:7453:1875495932141824:0@lo:253: 10000000:01000000:2.0:1788612401.196657:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788612401.196659:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612401.196661:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612401.196663:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612401.196664:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612401.196665:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612401.196666:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612401.196667:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612401.196668:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612401.196670:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612401.196671:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612401.196672:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612401.196682:0:7453:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788612401.198567:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932141952 00000100:00100000:0.0:1788612401.198605:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932141952 00000100:00100000:0.0:1788612401.198641:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142080 00000100:00100000:0.0:1788612401.198645:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142080 00000100:00100000:0.0:1788612401.198661:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612401.198668:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000514a28bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6539:x1875495932141952:12345-0@lo:104: 00010000:00010000:0.0:1788612401.198683:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.198775:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612401.198780:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000514a28bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6539:x1875495932141952:12345-0@lo:104: Request processed in 113us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612401.198787:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612401.198802:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612401.199070:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ea8cd35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932141952:0@lo:104: 00000100:00100000:0.0:1788612401.199147:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041ffe439 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932142080:12345-0@lo:104: 00010000:00010000:0.0:1788612401.199155:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.199201:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612401.199207:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041ffe439 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932142080:12345-0@lo:104: Request processed in 388us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612401.199212:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612401.199283:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a822c23d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932142080:0@lo:104: 00010000:00010000:3.0:1788612401.199303:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.200665:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612401.200674:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.200684:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cbe04ad8 already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612401.200687:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.200696:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612401.200702:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612401.200707:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612401.200753:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.200767:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788612401.200814:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005be7a172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932142208:0@lo:103: 00000100:00100000:3.0:1788612401.200982:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612401.201966:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.201977:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000cbe04ad8/0x1f8616bf0bc7c55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c5c expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.201993:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612401.201995:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202020:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a85738c7 already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612401.202022:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202030:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612401.202035:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612401.202041:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612401.202073:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202080:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612401.202095:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202101:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000a85738c7/0x1f8616bf0bc7bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7bb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202114:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612401.202116:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612401.202117:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612401.202126:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612401.202156:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142208 00000100:00100000:1.0:1788612401.202162:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142208 00010000:00010000:1.0:1788612401.202185:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 15 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.202239:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612401.202247:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a822c23d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3651:x1875495932142208:12345-0@lo:103: 00010000:00010000:1.0:1788612401.202259:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612401.202263:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 15 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202272:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 15 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202284:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000207b0f89/0x1f8616bf0bc7c5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7c55 expref: 15 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.202295:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:2.0:1788612401.210333:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788612401.210543:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788612401.210741:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788612401.210935:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788612401.211142:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788612401.211290:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788612401.212217:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a822c23d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:3651:x1875495932142208:12345-0@lo:103: Request processed in 9957us (11334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.212230:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612401.212266:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612401.212280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932142336:0@lo:103: 00000100:00100000:1.0:1788612401.212334:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.212390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142336 00000100:00100000:1.0:1788612401.212396:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142336 00010000:00010000:1.0:1788612401.212420:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.212449:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612401.212456:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f43bca84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:3649:x1875495932142336:12345-0@lo:103: 00010000:00010000:1.0:1788612401.212466:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612401.212490:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212502:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212517:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7bad expref: 14 pid: 6518 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212532:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212540:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788612401.212554:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016303027s 00010000:00010000:1.0:1788612401.212558:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212563:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212568:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212587:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212594:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c25f0f3f already unused, calling callback (00000000d11f7c87) 00010000:00010000:1.0:1788612401.212597:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212604:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212632:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.212642:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612401.212674:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f43bca84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:3649:x1875495932142336:12345-0@lo:103: Request processed in 218us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.212680:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612401.212734:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006ecb08b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932142336:0@lo:103: 00080000:10000000:2.0:1788612401.216058:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00000100:00100000:3.0:1788612401.216409:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005be7a172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932142208:0@lo:103: 00010000:00010000:3.0:1788612401.216442:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.216452:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.216465:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7c94 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788612401.216864:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788612401.217059:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788612401.217186:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788612401.217346:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788612401.217545:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788612401.220513:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788612401.220683:0:7477:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788612401.220688:0:7477:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788612401.220919:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788612401.220964:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ea8cd35 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875495932142464:0@lo:700: 00000100:00100000:3.0:1788612401.221024:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.221061:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 000000005236950b going to sleep for 11 seconds 00000100:00100000:0.0:1788612401.221158:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142464 00000100:00100000:0.0:1788612401.221165:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142464 00000100:00100000:0.0:1788612401.221218:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612401.221226:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e8fe37a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1875495932142464:12345-0@lo:700: 00000040:01000000:0.0:1788612401.221320:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788612401.222198:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932142592:0@lo:1000: 00000040:01000000:0.0:1788612401.222998:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788612401.223106:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788612401.223960:0:7453:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788612401.223970:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1788612401.225767:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.225805:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142592 00000100:00100000:2.0:1788612401.225811:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142592 00000100:00100000:2.0:1788612401.225875:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612401.225883:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004031d214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932142592:12345-0@lo:1000: 00000100:00100000:2.0:1788612401.225970:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004031d214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932142592:12345-0@lo:1000: Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612401.225978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612401.226002:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000726ea2eb going to sleep for 11 seconds 00000100:00100000:2.0:1788612401.226026:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932142592:0@lo:1000: 00000040:01000000:2.0:1788612401.226059:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788612401.226090:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932142720:0@lo:700: 00000100:00100000:2.0:1788612401.226114:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.226137:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000970942b4 going to sleep for 11 seconds 00000040:00080000:0.0:1788612401.227730:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612401.229332:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142720 00000100:00100000:3.0:1788612401.229345:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142720 00000100:00100000:3.0:1788612401.229391:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612401.229399:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000493bd786 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932142720:12345-0@lo:700: 00000100:00100000:3.0:1788612401.231319:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000493bd786 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932142720:12345-0@lo:700: Request processed in 1915us (5199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.231332:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612401.234116:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932142720:0@lo:700: 00000100:00100000:2.0:1788612401.234196:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875495932142848:0@lo:900: 00000100:00100000:2.0:1788612401.234262:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.234305:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000970942b4 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.234674:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142848 00000100:00100000:1.0:1788612401.234681:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142848 00000100:00100000:1.0:1788612401.234731:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612401.234740:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cbfa7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1875495932142848:12345-0@lo:900: 00000100:00100000:1.0:1788612401.234810:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cbfa7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1875495932142848:12345-0@lo:900: Request processed in 71us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.234817:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1788612401.234991:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:2.0:1788612401.236177:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005fb6aa7c x1875495932142848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.236192:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875495932142848:0@lo:900: 00000100:00100000:2.0:1788612401.236320:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932142976:0@lo:1000: 00000100:00100000:2.0:1788612401.236369:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.236399:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8ea90e7 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.236450:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932142976 00000100:00100000:1.0:1788612401.236456:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932142976 00000100:00100000:1.0:1788612401.236519:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612401.236526:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009deb5d9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932142976:12345-0@lo:1000: 00000100:00100000:1.0:1788612401.236697:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009deb5d9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932142976:12345-0@lo:1000: Request processed in 171us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.236704:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612401.236997:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932142976:0@lo:1000: 00000004:00080000:2.0:1788612401.237048:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000970942b4 with version 0 00000020:00100000:2.0:1788612401.237063:0:7479:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788612401.237068:0:7479:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005fb6aa7c x1875495932143232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612401.237081:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932143232:0@lo:1000: 00000100:00100000:2.0:1788612401.237103:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.237154:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088dcda6c going to sleep for 11 seconds 00000040:00080000:0.0:1788612401.237442:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788612401.238681:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788612401.238923:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788612401.239284:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 40000000:02000000:2.0:1788612401.240105:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1788612401.246351:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932143232 00000100:00100000:1.0:1788612401.246364:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932143232 00000100:00100000:1.0:1788612401.246411:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612401.246419:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fb4eae6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932143232:12345-0@lo:1000: 00100000:10000000:0.0:1788612401.247972:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788612401.248130:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788612401.248260:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788612401.248407:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788612401.248579:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788612401.248776:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788612401.248899:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788612401.249025:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788612401.249192:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788612401.249313:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788612401.249436:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788612401.249583:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788612401.249716:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788612401.255101:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788612401.255296:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788612401.255427:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000001:00080000:3.0:1788612401.255732:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788612401.256007:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fb4eae6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932143232:12345-0@lo:1000: Request processed in 9586us (18900us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788612401.256019:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788612401.256109:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788612401.256114:0:7479:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788612401.256128:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fb6aa7c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932143232:0@lo:1000: 00000100:00100000:3.0:1788612401.256207:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932143360:0@lo:1000: 00000100:00100000:3.0:1788612401.256245:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.256278:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932143360 00000100:00100000:3.0:1788612401.256284:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932143360 00000100:00100000:3.0:1788612401.256363:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612401.256371:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d3ac00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932143360:12345-0@lo:1000: 00000100:00100000:3.0:1788612401.256441:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d3ac00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875495932143360:12345-0@lo:1000: Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.256448:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:0.0:1788612401.256744:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788612401.256896:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788612401.257037:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788612401.257195:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788612401.257339:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788612401.257470:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788612401.257678:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788612401.257845:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788612401.258003:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788612401.258139:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788612401.258286:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788612401.258433:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788612401.258588:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788612401.258716:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000100:00100000:2.0:1788612401.259140:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e8fe37a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1875495932142464:12345-0@lo:700: Request processed in 37912us (38114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612401.259157:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788612401.259204:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004ea8cd35 x1875495932142464/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788612417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.259217:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ea8cd35 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875495932142464:0@lo:700: 40000000:02000000:2.0:1788612401.259228:0:7478:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788612401.262653:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788612401.262851:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788612401.263064:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788612401.272865:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000706d3149 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.272907:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875495932143360:0@lo:1000: 00000040:00080000:3.0:1788612401.272932:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788612401.272967:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000022569318 with version 1 00000004:00080000:0.0:1788612401.275341:0:7469:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a91f5c80 version 1 rpc_version 1 00000020:00100000:0.0:1788612401.275386:0:7469:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788612401.275395:0:7469:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f37c8ac8 x1875495932143616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612401.275419:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f37c8ac8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1875495932143616:0@lo:1000: 00000100:00100000:0.0:1788612401.275517:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.275567:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c41f4fa9 going to sleep for 11 seconds 00000001:00080000:0.0:1788612401.276025:0:7453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788612401.276055:0:7453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9b941dc7988 00100000:10000000:0.0:1788612401.276063:0:7453:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1788612401.280028:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932143616 00000100:00100000:0.0:1788612401.280043:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932143616 00000100:00100000:0.0:1788612401.280107:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612401.280116:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003810fff7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875495932143616:12345-0@lo:1000: 00000001:00080000:0.0:1788612401.282685:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788612401.282799:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003810fff7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875495932143616:12345-0@lo:1000: Request processed in 2683us (7281us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788612401.282810:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788612401.282868:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788612401.282873:0:7469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788612401.282889:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f37c8ac8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1875495932143616:0@lo:1000: 00000040:00080000:3.0:1788612401.283169:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788612401.283362:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:01000004:0.0:1788612401.287748:0:7453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612401.287792:0:7453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612401.287810:0:7453:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788612401.287834:0:7453:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788612401.288769:0:7453:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612401.289120:0:7453:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788612401.332306:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612401.345501:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788612401.345750:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788612401.345756:0:7478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788612401.519775:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612402.545112:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612403.577035:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612404.600942:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612405.615670:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612406.255778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f37c8ac8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932143744:0@lo:41: 00000100:00100000:1.0:1788612406.255846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612406.260906:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932143744 00000100:00100000:0.0:1788612406.260923:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932143744 00000100:00100000:0.0:1788612406.260991:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612406.261013:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006ecb08b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932143744:12345-0@lo:41: 00000004:00000024:0.0:1788612406.261053:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788612406.261139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006ecb08b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932143744:12345-0@lo:41: Request processed in 139us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612406.261146:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612406.261201:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f37c8ac8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932143744:0@lo:41: 00000100:00100000:2.0:1788612406.261852:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309dfd61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932144128:0@lo:400: 00000100:00100000:2.0:1788612406.261900:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612406.261947:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b33c1925 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932143872:0@lo:400: 00000100:00100000:2.0:1788612406.261977:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612406.261995:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612406.262000:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea9c03bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932144000:0@lo:400: 00000100:00100000:2.0:1788612406.262022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612406.262052:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144128 00000100:00100000:2.0:1788612406.262057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144128 00000100:00100000:2.0:1788612406.262102:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144000 00000100:00100000:2.0:1788612406.262106:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144000 00000100:00100000:2.0:1788612406.262122:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612406.262128:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f38557a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932144128:12345-0@lo:400: 00000100:00100000:2.0:1788612406.262166:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f38557a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932144128:12345-0@lo:400: Request processed in 39us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612406.262174:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612406.262188:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612406.262194:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eef027e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932144000:12345-0@lo:400: 00000100:00100000:2.0:1788612406.262225:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eef027e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932144000:12345-0@lo:400: Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612406.262231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612406.262250:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932143872 00000100:00100000:2.0:1788612406.262254:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932143872 00000100:00100000:2.0:1788612406.262277:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612406.262283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032516b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:3650:x1875495932143872:12345-0@lo:400: 00000100:00100000:2.0:1788612406.262311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032516b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:3650:x1875495932143872:12345-0@lo:400: Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612406.262317:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788612406.262362:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ea9c03bb x1875495932144000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612406.262373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea9c03bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932144000:0@lo:400: 00000100:00100000:2.0:1788612406.262383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b33c1925 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932143872:0@lo:400: 00010000:00080000:2.0:1788612406.262406:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000309dfd61 x1875495932144128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612406.262416:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309dfd61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932144128:0@lo:400: 00010000:00010000:1.0:1788612406.641163:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788612406.837786:0:7724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788612407.471159:0:7776:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612407.471349:0:7776:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612407.664634:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612408.303757:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612408.303766:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612fccf8000 from 4 10000000:01000000:1.0:1788612408.303770:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612408.303815:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612408.303826:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612408.303836:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612408.303857:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e32eeff2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144256:0@lo:101: 00000100:00100000:1.0:1788612408.303919:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.303970:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080807259 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.304028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144256 00000100:00100000:3.0:1788612408.304036:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144256 00000100:00100000:3.0:1788612408.304086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612408.304094:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e8bf3f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:6520:x1875495932144256:12345-0@lo:101: 00010000:00010000:3.0:1788612408.304115:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612408.304129:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7c9b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304151:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304172:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c25f0f3f/0x1f8616bf0bc7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304180:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c25f0f3f, rc 0) 00000100:00100000:3.0:1788612408.304223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e8bf3f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:6520:x1875495932144256:12345-0@lo:101: Request processed in 131us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.304230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612408.304273:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e32eeff2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144256:0@lo:101: 00010000:00010000:3.0:1788612408.304286:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304293:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.304336:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144384:0@lo:256: 00000100:00100000:3.0:1788612408.304365:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.304393:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b14eaac0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.304409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144384 00000100:00100000:3.0:1788612408.304413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144384 00000100:00100000:3.0:1788612408.304435:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612408.304440:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c19945f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:6520:x1875495932144384:12345-0@lo:256: 20000000:01000000:3.0:1788612408.304452:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612408.304466:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612408.304469:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788612408.304594:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c19945f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:6520:x1875495932144384:12345-0@lo:256: Request processed in 153us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.304601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612408.304636:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144384:0@lo:256: 10000000:01000000:3.0:1788612408.304673:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612408.304679:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304686:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000c4eaab54/0x1f8616bf0bc7c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612408.304695:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788612408.304696:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612c7237000 from 21 10000000:01000000:3.0:1788612408.304698:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612408.304724:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304730:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304736:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.304746:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144512:0@lo:101: 00000100:00100000:3.0:1788612408.304769:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.304788:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b14eaac0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.304798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144512 00000100:00100000:3.0:1788612408.304801:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144512 00000100:00100000:3.0:1788612408.304819:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612408.304824:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d90a1f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:6520:x1875495932144512:12345-0@lo:101: 00010000:00010000:3.0:1788612408.304830:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612408.304837:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7ca9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304855:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304862:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a85738c7/0x1f8616bf0bc7cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304868:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a85738c7, rc 0) 00000100:00100000:3.0:1788612408.304893:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d90a1f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932144512:12345-0@lo:101: Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.304898:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612408.304921:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144512:0@lo:101: 00010000:00010000:3.0:1788612408.304929:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.304935:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.304981:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144640:0@lo:501: 00000100:00100000:3.0:1788612408.305003:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.305015:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b14eaac0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.305026:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144640 00000100:00100000:3.0:1788612408.305029:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144640 00000100:00100000:3.0:1788612408.305047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612408.305051:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f715595d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932144640:12345-0@lo:501: 00000100:00100000:3.0:1788612408.305151:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f715595d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932144640:12345-0@lo:501: Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.305157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612408.305190:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144640:0@lo:501: 00000100:00100000:3.0:1788612408.305212:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144768:0@lo:503: 00000100:00100000:3.0:1788612408.305247:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.305260:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b14eaac0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.305270:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144768 00000100:00100000:3.0:1788612408.305273:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144768 00000100:00100000:3.0:1788612408.305292:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788612408.305297:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005790db49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932144768:12345-0@lo:503: 00000100:00100000:3.0:1788612408.305367:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005790db49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932144768:12345-0@lo:503: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.305373:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788612408.305408:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932144768:0@lo:503: 00000100:00100000:3.0:1788612408.305596:0:7802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7802:1875495932144896:0@lo:502: 00000100:00100000:3.0:1788612408.305629:0:7802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.305647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932144896 00000100:00100000:3.0:1788612408.305651:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932144896 00000100:00100000:3.0:1788612408.305671:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612408.305677:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d70fd39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7802:x1875495932144896:12345-0@lo:502: 00000100:00100000:3.0:1788612408.305755:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d70fd39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7802:x1875495932144896:12345-0@lo:502: Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.305760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612408.305792:0:7802:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.305803:0:7802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7802:1875495932144896:0@lo:502: 00000100:00100000:3.0:1788612408.305840:0:7802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7802:1875495932145024:0@lo:502: 00000100:00100000:3.0:1788612408.305868:0:7802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.305889:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145024 00000100:00100000:3.0:1788612408.305892:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145024 00000100:00100000:3.0:1788612408.305909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788612408.305914:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5af8264 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7802:x1875495932145024:12345-0@lo:502: 00000100:00100000:3.0:1788612408.305964:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5af8264 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:7802:x1875495932145024:12345-0@lo:502: Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.305970:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788612408.305994:0:7802:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.306005:0:7802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7802:1875495932145024:0@lo:502: 00000040:00080000:3.0:1788612408.306022:0:7802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788612408.306070:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788612408.306085:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612408.306089:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306096:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000207b0f89/0x1f8616bf0bc7ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612408.306103:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612408.306105:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c7237000 from 4 10000000:01000000:3.0:1788612408.306107:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612408.306123:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306129:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306135:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.306154:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145152:0@lo:101: 00000100:00100000:3.0:1788612408.306177:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.306190:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.306201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145152 00000100:00100000:3.0:1788612408.306205:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145152 00000100:00100000:3.0:1788612408.306224:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612408.306228:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c61c0f9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932145152:12345-0@lo:101: 00010000:00010000:3.0:1788612408.306235:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612408.306243:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e1ef0a0/0x1f8616bf0bc7cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7cb7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306256:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e1ef0a0/0x1f8616bf0bc7cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306264:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e1ef0a0/0x1f8616bf0bc7cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306270:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e1ef0a0, rc 0) 00000100:00100000:3.0:1788612408.306294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c61c0f9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932145152:12345-0@lo:101: Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.306300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612408.306325:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145152:0@lo:101: 00010000:00010000:3.0:1788612408.306335:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306342:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.306388:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145280:0@lo:256: 00000100:00100000:3.0:1788612408.306416:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.306428:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.306438:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145280 00000100:00100000:3.0:1788612408.306441:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145280 00000100:00100000:3.0:1788612408.306459:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612408.306464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dd16cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932145280:12345-0@lo:256: 20000000:01000000:3.0:1788612408.306499:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612408.306513:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612408.306516:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788612408.306583:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dd16cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932145280:12345-0@lo:256: Request processed in 118us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.306590:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612408.306616:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145280:0@lo:256: 10000000:01000000:3.0:1788612408.306649:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612408.306653:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306659:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000027ccc2c7/0x1f8616bf0bc7cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612408.306665:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788612408.306667:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788612408.306669:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788612408.306682:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306697:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306704:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.306725:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145408:0@lo:101: 00000100:00100000:3.0:1788612408.306746:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.306764:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.306775:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145408 00000100:00100000:3.0:1788612408.306778:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145408 00000100:00100000:3.0:1788612408.306799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788612408.306803:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e04061d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932145408:12345-0@lo:101: 00010000:00010000:3.0:1788612408.306809:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612408.306816:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096f717e7/0x1f8616bf0bc7ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7cc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306828:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096f717e7/0x1f8616bf0bc7ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306835:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096f717e7/0x1f8616bf0bc7ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306840:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096f717e7, rc 0) 00000100:00100000:3.0:1788612408.306866:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e04061d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932145408:12345-0@lo:101: Request processed in 63us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.306871:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788612408.306897:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145408:0@lo:101: 00010000:00010000:3.0:1788612408.306913:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612408.306919:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612408.306958:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145536:0@lo:501: 00000100:00100000:3.0:1788612408.306980:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.306990:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.306999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145536 00000100:00100000:3.0:1788612408.307002:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145536 00000100:00100000:3.0:1788612408.307018:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612408.307023:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a533f776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932145536:12345-0@lo:501: 00000100:00100000:3.0:1788612408.307094:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a533f776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932145536:12345-0@lo:501: Request processed in 72us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.307100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612408.307123:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145536:0@lo:501: 00000100:00100000:3.0:1788612408.307143:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145664:0@lo:503: 00000100:00100000:3.0:1788612408.307172:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.307184:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cf1025b going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.307193:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145664 00000100:00100000:3.0:1788612408.307195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145664 00000100:00100000:3.0:1788612408.307212:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612408.307216:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080dfb7b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932145664:12345-0@lo:503: 00000100:00100000:3.0:1788612408.307277:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080dfb7b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932145664:12345-0@lo:503: Request processed in 60us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.307283:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612408.307322:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932145664:0@lo:503: 00000100:00100000:0.0:1788612408.313154:0:7803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f37c8ac8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7803:1875495932145792:0@lo:502: 00000100:00100000:0.0:1788612408.313239:0:7803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612408.313283:0:7803:0:(client.c:2716:ptlrpc_set_wait()) set 000000001455d1d7 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.313406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145792 00000100:00100000:3.0:1788612408.313414:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145792 00000100:00100000:3.0:1788612408.313462:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612408.313470:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc5ee95f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:7803:x1875495932145792:12345-0@lo:502: 00000100:00100000:3.0:1788612408.313632:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc5ee95f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:7803:x1875495932145792:12345-0@lo:502: Request processed in 163us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.313640:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788612408.313986:0:7803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f37c8ac8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7803:1875495932145792:0@lo:502: 00000020:01000000:1.0:1788612408.314017:0:7803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612408.314028:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612408.314031:0:7803:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788612408.314036:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788612408.314045:0:7803:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:1.0:1788612408.314067:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612408.314082:0:7803:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000a5af490a) 00000020:00000080:1.0:1788612408.314113:0:7803:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788612408.314120:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788612408.314191:0:7803:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788612408.314197:0:7803:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788612408.314203:0:7803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7cda 00010000:00080000:1.0:1788612408.314232:0:7803:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000095635b3@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612408.325218:0:7803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788612408.332511:0:7803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612408.333933:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788612408.333981:0:7803:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788612408.334003:0:7803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7ce1 00000100:00080000:1.0:1788612408.334358:0:7803:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612408.334365:0:7803:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000095635b3 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612408.334616:0:7803:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000031771f79 x1875495932145920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612408.334644:0:7803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788612408.334744:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932146048:0@lo:400: 00000100:00100000:1.0:1788612408.334801:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.334857:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932146176:0@lo:400: 00000100:00100000:1.0:1788612408.334883:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.334906:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612408.334912:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932146304:0@lo:400: 00000100:00100000:1.0:1788612408.334936:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.334969:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146048 00000100:00100000:1.0:1788612408.334976:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146048 00000100:00100000:1.0:1788612408.335011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146304 00000100:00100000:1.0:1788612408.335038:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146304 00000100:00100000:1.0:1788612408.335057:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612408.335063:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0eaba63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932146048:12345-0@lo:400: 00000100:00100000:1.0:1788612408.335122:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0eaba63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932146048:12345-0@lo:400: Request processed in 58us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612408.335129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612408.335145:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612408.335151:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e66ac96a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932146304:12345-0@lo:400: 00000100:00100000:1.0:1788612408.335181:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e66ac96a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932146304:12345-0@lo:400: Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612408.335187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612408.335204:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146176 00000100:00100000:1.0:1788612408.335207:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146176 00000100:00100000:1.0:1788612408.335229:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612408.335234:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000181c9819 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932146176:12345-0@lo:400: 00000100:00100000:1.0:1788612408.335266:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000181c9819 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932146176:12345-0@lo:400: Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612408.335272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788612408.335324:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e7af02b4 x1875495932146304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612408.335337:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932146304:0@lo:400: 00000100:00100000:1.0:1788612408.335347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932146176:0@lo:400: 00010000:00080000:1.0:1788612408.335373:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000035919e74 x1875495932146048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612408.335381:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932146048:0@lo:400: 00000040:01000000:1.0:1788612408.335425:0:7803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788612408.336224:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031771f79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932145920:0@lo:38: 00000100:00100000:0.0:1788612408.336273:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.336367:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932145920 00000100:00100000:1.0:1788612408.336373:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932145920 00000100:00100000:1.0:1788612408.336402:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612408.336407:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4138763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932145920:12345-0@lo:38: 00010000:00080000:1.0:1788612408.336430:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1788612408.336463:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7ce8 00000004:00100000:1.0:1788612408.336500:0:6528:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788612408.336505:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788612408.336898:0:7810:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000035919e74 x1875495932146432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612408.336908:0:7810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd48a92e going to sleep for 0 seconds 00000020:01000000:1.0:1788612408.336966:0:7803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612408.336973:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612408.336975:0:7803:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788612408.336978:0:7803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612408.336982:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612408.336983:0:7803:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788612408.336987:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788612408.336988:0:7803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788612408.337006:0:7803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7803:1875495932146560:0@lo:502: 00000100:00100000:1.0:1788612408.337070:0:7803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.337097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146560 00000100:00100000:1.0:1788612408.337102:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146560 00000100:00100000:0.0:1788612408.337729:0:7803:0:(client.c:2716:ptlrpc_set_wait()) set 000000009017a560 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.337858:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612408.337869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b3133f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:7803:x1875495932146560:12345-0@lo:502: 00000100:00100000:3.0:1788612408.337991:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b3133f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:7803:x1875495932146560:12345-0@lo:502: Request processed in 125us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.337999:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788612408.338118:0:7803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:7803:1875495932146560:0@lo:502: 00000020:01000000:0.0:1788612408.338144:0:7803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612408.338149:0:7803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612408.338151:0:7803:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788612408.338153:0:7803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788612408.338411:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788612408.338433:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788612408.338441:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612408.338461:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000001b2f6445/0x1f8616bf0bc7cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612408.338471:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788612408.338540:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9612d1e64d40 from 1 10000000:01000000:1.0:1788612408.338543:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788612408.338694:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612408.338703:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612408.338724:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612408.338741:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932146688:0@lo:101: 00000100:00100000:1.0:1788612408.338778:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.338805:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000009017a560 going to sleep for 11 seconds 00000100:00100000:0.0:1788612408.338917:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146688 00000100:00100000:0.0:1788612408.338923:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146688 00000100:00100000:0.0:1788612408.338961:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612408.338968:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000897c82c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932146688:12345-0@lo:101: 00010000:00010000:0.0:1788612408.338985:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612408.338997:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7cef expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612408.339029:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612408.339038:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000441eabea/0x1f8616bf0bc7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612408.339046:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000441eabea, rc 0) 00000100:00100000:0.0:1788612408.339077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000897c82c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932146688:12345-0@lo:101: Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612408.339083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788612408.339273:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932146688:0@lo:101: 00010000:00010000:1.0:1788612408.339296:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612408.339304:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612408.339352:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932146816:0@lo:501: 00000100:00100000:1.0:1788612408.339376:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.339405:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000009017a560 going to sleep for 11 seconds 00000100:00100000:1.0:1788612408.339419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146816 00000100:00100000:1.0:1788612408.339423:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146816 00000100:00100000:1.0:1788612408.339445:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612408.339450:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cfe25a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932146816:12345-0@lo:501: 00000100:00100000:1.0:1788612408.339804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cfe25a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932146816:12345-0@lo:501: Request processed in 353us (426us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612408.339812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788612408.339879:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932146816:0@lo:501: 10000000:01000000:0.0:1788612408.339904:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788612408.339909:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612408.339917:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000d97f0138/0x1f8616bf0bc7cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788612408.349687:0:6528:0:(import.c:65:import_set_state_nolock()) 000000007ff6d638 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612408.349827:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4138763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932145920:12345-0@lo:38: Request processed in 13417us (13552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612408.349837:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612408.350532:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612408.350544:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788612408.350554:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788612408.350559:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788612408.350561:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000095635b3 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788612408.350586:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fd48a92e): req@0000000035919e74 x1875495932146432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612408.350616:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031771f79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932145920:0@lo:38: 00000100:00100000:2.0:1788612408.350740:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612408.350751:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000309dfd61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932146944:0@lo:41: 00000100:00100000:2.0:1788612408.350797:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612408.350840:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146944 00000100:00100000:2.0:1788612408.350847:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146944 00000100:00100000:2.0:1788612408.350882:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612408.350891:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b33c1925 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932146944:12345-0@lo:41: 00000004:00000024:2.0:1788612408.350914:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788612408.350966:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b33c1925 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932146944:12345-0@lo:41: Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612408.350972:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612408.351003:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000309dfd61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932146944:0@lo:41: 00000100:00100000:1.0:1788612408.352337:0:7810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.352373:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932146432 00000100:00100000:1.0:1788612408.352379:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932146432 00000100:00100000:1.0:1788612408.352412:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612408.352420:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e764fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932146432:12345-0@lo:1000: 00000100:00100000:1.0:1788612408.352506:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e764fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932146432:12345-0@lo:1000: Request processed in 87us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612408.352513:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612408.353844:0:7810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932146432:0@lo:1000: 00000040:01000000:1.0:1788612408.353880:0:7810:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788612408.353919:0:7810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147072:0@lo:1000: 00000100:00100000:1.0:1788612408.354150:0:7810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612408.354686:0:7810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd48a92e going to sleep for 11 seconds 00000100:00100000:0.0:1788612408.358250:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932147072 00000100:00100000:0.0:1788612408.358265:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932147072 00000100:00100000:0.0:1788612408.358372:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612408.358381:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1f65d43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147072:12345-0@lo:1000: 00000100:00100000:0.0:1788612408.358602:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1f65d43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147072:12345-0@lo:1000: Request processed in 222us (4453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612408.358609:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612408.358702:0:7810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147072:0@lo:1000: 00000100:00100000:3.0:1788612408.358776:0:7810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147200:0@lo:700: 00000100:00100000:3.0:1788612408.358809:0:7810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.358831:0:7810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000706d3149 going to sleep for 11 seconds 00000100:00100000:3.0:1788612408.358847:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932147200 00000100:00100000:3.0:1788612408.358850:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932147200 00000100:00100000:3.0:1788612408.358875:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612408.358881:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dc0128f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147200:12345-0@lo:700: 00000100:00100000:3.0:1788612408.358920:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dc0128f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147200:12345-0@lo:700: Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612408.358927:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612408.358969:0:7810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147200:0@lo:700: 00000100:00100000:3.0:1788612408.359079:0:7810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147328:0@lo:1000: 00000100:00100000:3.0:1788612408.359131:0:7810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.364289:0:7810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ead24293 going to sleep for 11 seconds 00000100:00100000:2.0:1788612408.364387:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932147328 00000100:00100000:2.0:1788612408.364396:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932147328 00000100:00100000:2.0:1788612408.364436:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612408.364445:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3879471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147328:12345-0@lo:1000: 00000100:00100000:2.0:1788612408.366205:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3879471 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147328:12345-0@lo:1000: Request processed in 1756us (7068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612408.366217:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612408.366376:0:7810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147328:0@lo:1000: 00000004:00080000:3.0:1788612408.366439:0:7810:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000706d3149 with version 0 00000020:00100000:3.0:1788612408.366462:0:7810:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788612408.366468:0:7810:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006b7f6d6a x1875495932147584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612408.366814:0:7810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147584:0@lo:1000: 00000100:00100000:0.0:1788612408.366858:0:7810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612408.366924:0:7810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c315f238 going to sleep for 11 seconds 00000100:00100000:2.0:1788612408.367053:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932147584 00000100:00100000:2.0:1788612408.367060:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932147584 00000100:00100000:2.0:1788612408.367197:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612408.367207:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e88997e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7810:x1875495932147584:12345-0@lo:1000: 00000001:00080000:0.0:1788612408.369451:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788612408.369464:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788612408.370678:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e88997e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7810:x1875495932147584:12345-0@lo:1000: Request processed in 3468us (3815us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788612408.370691:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788612408.370854:0:7810:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788612408.370859:0:7810:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788612408.370876:0:7810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b7f6d6a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147584:0@lo:1000: 00000100:00100000:0.0:1788612408.371833:0:7810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8b123b7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147712:0@lo:1000: 00000100:00100000:0.0:1788612408.371882:0:7810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612408.371915:0:7810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000535a32fc going to sleep for 11 seconds 00000100:00100000:1.0:1788612408.372580:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932147712 00000100:00100000:1.0:1788612408.372590:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932147712 00000100:00100000:1.0:1788612408.372659:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612408.372675:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a81c985b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7810:x1875495932147712:12345-0@lo:1000: 00000100:00100000:1.0:1788612408.372774:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a81c985b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7810:x1875495932147712:12345-0@lo:1000: Request processed in 99us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612408.372782:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612408.373832:0:7810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8b123b7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7810:1875495932147712:0@lo:1000: 00000040:00080000:0.0:1788612408.373860:0:7810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788612408.373899:0:7810:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000c315f238 with version 1 00000004:00080000:1.0:1788612408.375379:0:7807:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c0e12f7f version 1 rpc_version 1 00000020:00100000:1.0:1788612408.375416:0:7807:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788612408.375423:0:7807:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000035919e74 x1875495932147968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612408.375443:0:7807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7807:1875495932147968:0@lo:1000: 00000100:00100000:1.0:1788612408.375527:0:7807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612408.375698:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932147968 00000100:00100000:3.0:1788612408.375705:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932147968 00000100:00100000:3.0:1788612408.375749:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612408.375755:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031771f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7807:x1875495932147968:12345-0@lo:1000: 00000100:00100000:1.0:1788612408.375882:0:7807:0:(client.c:2716:ptlrpc_set_wait()) set 000000009017a560 going to sleep for 11 seconds 00000040:00080000:0.0:1788612408.379921:0:7810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788612408.380794:0:7810:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788612408.380800:0:7810:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788612408.384204:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788612408.385121:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031771f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7807:x1875495932147968:12345-0@lo:1000: Request processed in 9361us (9596us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788612408.385135:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788612408.385252:0:7807:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788612408.385257:0:7807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788612408.385271:0:7807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035919e74 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7807:1875495932147968:0@lo:1000: 00010000:00010000:1.0:1788612408.687626:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612409.712198:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612410.736009:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612410.913079:0:7882:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612410.913293:0:7882:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788612411.376322:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612411.376347:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efd659bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932148096:0@lo:41: 00000100:00100000:3.0:1788612411.376904:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612411.376967:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148096 00000100:00100000:3.0:1788612411.376974:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148096 00000100:00100000:3.0:1788612411.377012:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612411.377019:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008504802d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932148096:12345-0@lo:41: 00000004:00000024:3.0:1788612411.377049:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788612411.377091:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008504802d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932148096:12345-0@lo:41: Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612411.377098:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612411.377148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efd659bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932148096:0@lo:41: 00010000:00010000:3.0:1788612411.764629:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788612412.245025:0:7931:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9bd98fd0 20000000:00000080:1.0:1788612412.245042:0:7931:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9613007b8c00 uarg=0000000000000000 20000000:01000000:1.0:1788612412.245204:0:7931:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788612412.245212:0:7931:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788612412.245216:0:7931:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788612412.245278:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788612412.245287:0:7931:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788612412.254679:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612412.270416:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788612412.270466:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788612412.270532:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788612412.270551:0:7931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788612412.270569:0:7931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612412.270587:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612412.270593:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612412.270600:0:7931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612412.270647:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612412.270659:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 17 pid: 6517 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612412.270673:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8b123b7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875495932148224:0@lo:104: 00000100:00100000:0.0:1788612412.270750:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612412.270802:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612412.270810:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 17 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612412.270818:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000353ce612 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875495932148352:0@lo:104: 00000100:00100000:0.0:1788612412.270845:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e361b318 going to sleep for 11 seconds 00000100:00100000:1.0:1788612412.271873:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788612412.271901:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612412.271923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148224 00000100:00100000:1.0:1788612412.271931:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148224 00000100:00100000:1.0:1788612412.271988:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148352 00000100:00100000:1.0:1788612412.271992:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148352 00000100:00100000:1.0:1788612412.272009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612412.272016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066912f7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:7931:x1875495932148224:12345-0@lo:104: 00010000:00010000:1.0:1788612412.272030:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272110:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612412.272116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066912f7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:7931:x1875495932148224:12345-0@lo:104: Request processed in 100us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612412.272122:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612412.272158:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612412.272164:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035919e74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:7931:x1875495932148352:12345-0@lo:104: 00010000:00010000:1.0:1788612412.272171:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272204:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612412.272209:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035919e74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:7931:x1875495932148352:12345-0@lo:104: Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612412.272215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788612412.272234:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612412.272238:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272245:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007caeb03d already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612412.272248:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272255:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612412.272267:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612412.272272:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612412.272297:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272304:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612412.272316:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272322:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000007caeb03d/0x1f8616bf0bc7c63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c6a expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272334:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612412.272336:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272341:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df7b7334 already unused, calling callback (0000000008ae653f) 10000000:00010000:1.0:1788612412.272343:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272348:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612412.272353:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612412.272358:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612412.272374:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272380:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612412.272384:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272390:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000df7b7334/0x1f8616bf0bc7b75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7b7c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612412.272401:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612412.272403:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612412.272404:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612412.272410:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612412.272426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932148480:0@lo:103: 00000100:00100000:1.0:1788612412.272454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612412.274602:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8b123b7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875495932148224:0@lo:104: 00000100:00100000:3.0:1788612412.274617:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000353ce612 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875495932148352:0@lo:104: 00010000:00010000:3.0:1788612412.274642:0:7931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612412.274756:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932148608:0@lo:103: 00000100:00100000:0.0:1788612412.274811:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612412.274871:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148480 00000100:00100000:0.0:1788612412.274877:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148480 00010000:00010000:0.0:1788612412.274905:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 18 pid: 6517 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612412.274940:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148608 00000100:00100000:0.0:1788612412.274943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148608 00010000:00010000:0.0:1788612412.274954:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 19 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612412.278670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612412.278706:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e32eeff2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932148480:12345-0@lo:103: 00010000:00010000:3.0:1788612412.278727:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612412.278735:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 19 pid: 6517 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278749:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 19 pid: 6517 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278766:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c707eb3/0x1f8616bf0bc7c6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7c63 expref: 19 pid: 6517 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278780:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612412.278860:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e32eeff2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3650:x1875495932148480:12345-0@lo:103: Request processed in 178us (6405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612412.278867:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612412.278891:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612412.278896:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012f0658d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:3651:x1875495932148608:12345-0@lo:103: 00010000:00010000:3.0:1788612412.278904:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612412.278907:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 17 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278931:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 17 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278940:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7b7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7b75 expref: 17 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278951:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278958:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278971:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278978:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278984:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278990:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.278997:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e37b206c already unused, calling callback (00000000d11f7c87) 00010000:00010000:3.0:1788612412.279000:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.279028:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.279051:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.279062:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612412.279100:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012f0658d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3651:x1875495932148608:12345-0@lo:103: Request processed in 204us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612412.279106:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788612412.279202:0:7931:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.279210:0:7931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612412.279216:0:7931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e37b206c/0x1f8616bf0bc7cfd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612412.280859:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932148608:0@lo:103: 00000100:00100000:1.0:1788612412.280900:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932148480:0@lo:103: 00010000:00010000:1.0:1788612412.783756:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612413.429918:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932148864:0@lo:400: 00000100:00100000:1.0:1788612413.429982:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612413.430035:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788612413.430043:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932148736:0@lo:400: 00000100:00100000:1.0:1788612413.430072:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612413.430095:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e71d21e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932149248:0@lo:400: 00000100:00100000:1.0:1788612413.430119:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612413.430150:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005be7a172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932148992:0@lo:400: 00000100:00100000:1.0:1788612413.430180:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612413.430198:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612413.430203:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7c59743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932149120:0@lo:400: 00000100:00100000:1.0:1788612413.430223:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612413.430254:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148864 00000100:00100000:1.0:1788612413.430260:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148864 00000100:00100000:1.0:1788612413.430301:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149120 00000100:00100000:1.0:1788612413.430304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149120 00000100:00100000:1.0:1788612413.430319:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612413.430325:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d911298 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932148864:12345-0@lo:400: 00000100:00100000:1.0:1788612413.430371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d911298 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932148864:12345-0@lo:400: Request processed in 46us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612413.430378:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612413.430392:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612413.430398:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f58a73c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932149120:12345-0@lo:400: 00000100:00100000:1.0:1788612413.430426:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f58a73c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932149120:12345-0@lo:400: Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612413.430431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612413.430448:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148736 00000100:00100000:1.0:1788612413.430451:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148736 00000100:00100000:1.0:1788612413.430495:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788612413.430501:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c614d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3649:x1875495932148736:12345-0@lo:400: 00000100:00100000:1.0:1788612413.430529:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c614d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3649:x1875495932148736:12345-0@lo:400: Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612413.430535:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788612413.430581:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f7c59743 x1875495932149120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612413.430606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7c59743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932149120:0@lo:400: 00000100:00100000:1.0:1788612413.430633:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af02b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932148736:0@lo:400: 00010000:00080000:1.0:1788612413.430641:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b1d73e57 x1875495932148864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612413.430648:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1d73e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932148864:0@lo:400: 00000100:00100000:2.0:1788612413.435873:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149248 00000100:00100000:2.0:1788612413.435891:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149248 00000100:00100000:2.0:1788612413.435953:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932148992 00000100:00100000:2.0:1788612413.435957:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932148992 00000100:00100000:2.0:1788612413.435975:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612413.435983:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb55de97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932149248:12345-0@lo:400: 00000100:00100000:2.0:1788612413.436076:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb55de97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932149248:12345-0@lo:400: Request processed in 94us (5956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612413.436082:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612413.436097:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612413.436102:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049df7ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932148992:12345-0@lo:400: 00000100:00100000:2.0:1788612413.436131:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049df7ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932148992:12345-0@lo:400: Request processed in 29us (5951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612413.436137:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612413.436329:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005be7a172 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932148992:0@lo:400: 00000100:00100000:1.0:1788612413.436360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7c59743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932149376:0@lo:41: 00000100:00100000:1.0:1788612413.436394:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612413.436425:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e71d21e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932149248:0@lo:400: 00000100:00100000:1.0:1788612413.436444:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149376 00000100:00100000:1.0:1788612413.436447:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149376 00000100:00100000:1.0:1788612413.436465:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612413.436470:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff443120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932149376:12345-0@lo:41: 00000004:00000024:1.0:1788612413.436512:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788612413.436547:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff443120 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932149376:12345-0@lo:41: Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612413.436554:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612413.436579:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7c59743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932149376:0@lo:41: 00010000:00010000:1.0:1788612413.808047:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612414.835821:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612415.856595:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612416.495622:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612416.495646:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efd659bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932149504:0@lo:41: 00000100:00100000:3.0:1788612416.495723:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.495798:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149504 00000100:00100000:3.0:1788612416.495806:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149504 00000100:00100000:3.0:1788612416.495848:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612416.495855:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c837322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932149504:12345-0@lo:41: 00000004:00000024:3.0:1788612416.495886:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788612416.495925:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c837322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932149504:12345-0@lo:41: Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.495931:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612416.495970:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efd659bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932149504:0@lo:41: 00010000:00010000:1.0:1788612416.879645:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612417.009618:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612417.009632:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fccf8000 from 1 10000000:01000000:1.0:1788612417.009637:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612417.009686:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000755b799d/0x1f8616bf0bc7d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.009698:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000755b799d/0x1f8616bf0bc7d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.009708:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000755b799d/0x1f8616bf0bc7d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612417.009731:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7c59743 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932149632:0@lo:101: 00000100:00100000:1.0:1788612417.009792:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612417.009843:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e361b318 going to sleep for 11 seconds 00000100:00100000:3.0:1788612417.009851:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149632 00000100:00100000:3.0:1788612417.009860:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149632 00000100:00100000:3.0:1788612417.009917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788612417.009926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a50ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932149632:12345-0@lo:101: 00010000:00010000:3.0:1788612417.009938:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612417.009951:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7d04 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009972:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009982:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049e67f65/0x1f8616bf0bc7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009990:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049e67f65, rc 0) 00000100:00100000:3.0:1788612417.010181:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a50ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932149632:12345-0@lo:101: Request processed in 256us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.010245:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788612417.016255:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7c59743 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932149632:0@lo:101: 00010000:00010000:0.0:1788612417.016283:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000755b799d/0x1f8616bf0bc7d04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.016294:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000755b799d/0x1f8616bf0bc7d04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612417.016371:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002626a768 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932149760:0@lo:501: 00000100:00100000:0.0:1788612417.016421:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612417.016456:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8ae4b3a going to sleep for 11 seconds 00000100:00100000:0.0:1788612417.016493:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149760 00000100:00100000:0.0:1788612417.016498:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149760 00000100:00100000:0.0:1788612417.016535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788612417.016543:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000429b7610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932149760:12345-0@lo:501: 00000100:00100000:0.0:1788612417.016648:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000429b7610 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932149760:12345-0@lo:501: Request processed in 106us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.016680:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788612417.016719:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002626a768 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932149760:0@lo:501: 00000100:00100000:0.0:1788612417.016741:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002626a768 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932149888:0@lo:503: 00000100:00100000:0.0:1788612417.016774:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612417.016785:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8ae4b3a going to sleep for 11 seconds 00000100:00100000:3.0:1788612417.016846:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932149888 00000100:00100000:3.0:1788612417.016851:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932149888 00000100:00100000:3.0:1788612417.016878:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788612417.016884:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3bcda3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932149888:12345-0@lo:503: 00000100:00100000:3.0:1788612417.016961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3bcda3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932149888:12345-0@lo:503: Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.016967:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788612417.016998:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002626a768 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932149888:0@lo:503: 00000100:00100000:3.0:1788612417.017387:0:8156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efd659bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8156:1875495932150016:0@lo:502: 00000100:00100000:3.0:1788612417.017425:0:8156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.017443:0:8156:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020520533 going to sleep for 11 seconds 00000100:00100000:0.0:1788612417.017586:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150016 00000100:00100000:0.0:1788612417.017591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150016 00000100:00100000:0.0:1788612417.017624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612417.017630:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5e31f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8156:x1875495932150016:12345-0@lo:502: 00000100:00100000:0.0:1788612417.017707:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5e31f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8156:x1875495932150016:12345-0@lo:502: Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.017713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788612417.017822:0:8156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efd659bf pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8156:1875495932150016:0@lo:502: 00000020:01000000:3.0:1788612417.017841:0:8156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612417.017849:0:8156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612417.017851:0:8156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612417.017858:0:8156:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612fccf8000 00000020:00000080:3.0:1788612417.017860:0:8156:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788612417.017892:0:8156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8156:1875495932150144:0@lo:502: 00000100:00100000:3.0:1788612417.017919:0:8156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.017949:0:8156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612417.018017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150144 00000100:00100000:0.0:1788612417.018021:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150144 00000100:00100000:0.0:1788612417.018045:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612417.018051:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8156:x1875495932150144:12345-0@lo:502: 00000100:00100000:0.0:1788612417.018106:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8156:x1875495932150144:12345-0@lo:502: Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.018112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612417.018181:0:8156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8156:1875495932150144:0@lo:502: 00000020:01000000:3.0:1788612417.018196:0:8156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612417.018200:0:8156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612417.018201:0:8156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788612417.018204:0:8156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788612417.018317:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788612417.018334:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612417.018342:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.018352:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612417.018371:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612417.018373:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c7237000 from 1 10000000:01000000:0.0:1788612417.018376:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612417.018395:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.018402:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.018410:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612417.018421:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932150272:0@lo:101: 00000100:00100000:0.0:1788612417.018445:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612417.018463:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612417.018571:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150272 00000100:00100000:3.0:1788612417.018576:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150272 00000100:00100000:3.0:1788612417.018604:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788612417.018611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932150272:12345-0@lo:101: 00010000:00010000:3.0:1788612417.018618:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612417.018629:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7d12 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.018647:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.018668:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.018685:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896a00, rc 0) 00000100:00100000:3.0:1788612417.018724:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932150272:12345-0@lo:101: Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.018729:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788612417.018783:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932150272:0@lo:101: 00010000:00010000:1.0:1788612417.018794:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.018802:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612417.018847:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932150400:0@lo:501: 00000100:00100000:1.0:1788612417.018872:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612417.018898:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c88bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612417.018998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150400 00000100:00100000:3.0:1788612417.019002:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150400 00000100:00100000:3.0:1788612417.019081:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788612417.019088:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932150400:12345-0@lo:501: 00000100:00100000:3.0:1788612417.019170:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932150400:12345-0@lo:501: Request processed in 82us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.019176:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788612417.026037:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932150400:0@lo:501: 00000100:00100000:3.0:1788612417.026098:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932150528:0@lo:503: 00000100:00100000:3.0:1788612417.026172:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.026295:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612417.027514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150528 00000100:00100000:0.0:1788612417.027524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150528 00000100:00100000:1.0:1788612417.027754:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612417.027764:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932150528:12345-0@lo:503: 00000100:00100000:1.0:1788612417.027908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932150528:12345-0@lo:503: Request processed in 146us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612417.027915:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612417.028138:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932150528:0@lo:503: 00000100:00100000:1.0:1788612417.028519:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8158:1875495932150656:0@lo:502: 00000100:00100000:1.0:1788612417.028790:0:8158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612417.028868:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c88bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612417.031073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150656 00000100:00100000:0.0:1788612417.031088:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150656 00000100:00100000:1.0:1788612417.031216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612417.031227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8158:x1875495932150656:12345-0@lo:502: 00000100:00100000:1.0:1788612417.031391:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8158:x1875495932150656:12345-0@lo:502: Request processed in 166us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612417.031399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612417.031524:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8158:1875495932150656:0@lo:502: 00000020:01000000:1.0:1788612417.031725:0:8158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612417.031735:0:8158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612417.031738:0:8158:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788612417.031747:0:8158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612c7237000 00000020:00000080:1.0:1788612417.031749:0:8158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788612417.031782:0:8158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8158:1875495932150784:0@lo:502: 00000100:00100000:1.0:1788612417.031824:0:8158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612417.031857:0:8158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0980900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612417.031954:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150784 00000100:00100000:0.0:1788612417.031959:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150784 00000100:00100000:0.0:1788612417.031991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788612417.031998:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8158:x1875495932150784:12345-0@lo:502: 00000100:00100000:0.0:1788612417.032077:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8158:x1875495932150784:12345-0@lo:502: Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.032084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788612417.032155:0:8158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8158:1875495932150784:0@lo:502: 00000020:01000000:3.0:1788612417.032174:0:8158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612417.032178:0:8158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612417.032180:0:8158:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788612417.032184:0:8158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788612417.032355:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788612417.032381:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612417.032390:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.032399:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.903571:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612418.543663:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932150912:0@lo:41: 00000100:00100000:1.0:1788612418.543725:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612418.543806:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932150912 00000100:00100000:1.0:1788612418.543813:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932150912 00000100:00100000:1.0:1788612418.543853:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612418.543873:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932150912:12345-0@lo:41: 00000004:00000024:1.0:1788612418.543904:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788612418.543943:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932150912:12345-0@lo:41: Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612418.543949:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612418.543991:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932150912:0@lo:41: 00000100:00100000:1.0:1788612418.545805:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932151168:0@lo:400: 00000100:00100000:0.0:1788612418.545825:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932151040:0@lo:400: 00000100:00100000:1.0:1788612418.545872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612418.545874:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612418.545925:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151168 00000100:00100000:1.0:1788612418.545931:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151168 00000100:00100000:0.0:1788612418.545933:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151040 00000100:00100000:0.0:1788612418.545939:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151040 00000100:00100000:0.0:1788612418.545976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612418.545981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612418.545988:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3648:x1875495932151040:12345-0@lo:400: 00000100:00100000:1.0:1788612418.545994:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932151168:12345-0@lo:400: 00000100:00100000:0.0:1788612418.546045:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3648:x1875495932151040:12345-0@lo:400: Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612418.546052:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932151168:12345-0@lo:400: Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612418.546054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612418.546065:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612418.546100:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932151296:0@lo:400: 00010000:00080000:1.0:1788612418.546108:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fb853800 x1875495932151168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612418.546121:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932151168:0@lo:400: 00000100:00100000:0.0:1788612418.546130:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612418.546156:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612418.546162:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932151424:0@lo:400: 00000100:00100000:0.0:1788612418.546186:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612418.546226:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932151040:0@lo:400: 00000100:00100000:0.0:1788612418.546243:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151296 00000100:00100000:0.0:1788612418.546246:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151296 00000100:00100000:0.0:1788612418.546272:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612418.546278:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932151296:12345-0@lo:400: 00000100:00100000:0.0:1788612418.546311:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932151296:12345-0@lo:400: Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612418.546328:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612418.546358:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932151296:0@lo:400: 00000100:00100000:1.0:1788612418.546656:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151424 00000100:00100000:1.0:1788612418.546661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151424 00000100:00100000:1.0:1788612418.546695:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612418.546701:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788612418.546705:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932151424:12345-0@lo:400: 00000100:00100000:0.0:1788612418.546711:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788612418.546753:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932151424:12345-0@lo:400: Request processed in 51us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612418.546760:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788612418.546828:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fb852300 x1875495932151424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612418.546839:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932151424:0@lo:400: 00010000:00010000:1.0:1788612418.927674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612419.951666:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612420.975730:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612421.616412:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932151552:0@lo:41: 00000100:00100000:0.0:1788612421.616502:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612421.616584:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151552 00000100:00100000:0.0:1788612421.616591:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151552 00000100:00100000:0.0:1788612421.616644:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612421.616653:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932151552:12345-0@lo:41: 00000004:00000024:0.0:1788612421.616683:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788612421.616723:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932151552:12345-0@lo:41: Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612421.616730:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612421.616775:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932151552:0@lo:41: 00000020:01000004:1.0:1788612421.844614:0:8432:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612421.844629:0:8432:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788612421.844630:0:8432:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788612421.844763:0:8432:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9612fcfb4000 00000020:01000004:1.0:1788612421.844780:0:8432:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788612421.844790:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788612421.844816:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9612fe9e8000) 00000020:00000080:1.0:1788612421.844833:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788612421.926716:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788612421.926790:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788612421.995173:0:8432:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788612421.995416:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788612421.995624:0:8432:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788612421.995641:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1f8616bf0bc7d27 00000020:01000004:1.0:1788612421.995648:0:8432:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788612421.995669:0:8432:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788612421.995673:0:8432:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788612421.995679:0:8432:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788612421.995683:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788612421.995694:0:8432:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9612fe9e99c0) 00000020:00000080:1.0:1788612421.995705:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00010000:00010000:1.0:1788612422.005387:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612422.010553:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612422.023325:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788612422.023334:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788612422.024337:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612422.024346:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788612422.030832:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788612422.032319:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788612422.036691:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612422.036891:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788612422.036898:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788612422.039219:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788612422.039231:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788612422.068825:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612422.069059:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788612422.069071:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788612422.071080:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788612422.071094:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788612422.072066:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788612422.072074:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788612422.075311:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612422.075712:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788612422.075719:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788612422.076227:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788612422.076241:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788612422.122060:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612422.122277:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788612422.122285:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788612422.125343:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788612422.125357:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788612422.131377:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788612422.131421:0:8432:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788612422.131437:0:8432:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788612422.148898:0:8432:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788612422.148936:0:8432:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788612422.148940:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788612422.148942:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612422.148943:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612422.148944:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612422.148946:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612422.148947:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612422.148948:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612422.148950:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612422.148951:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612422.148953:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612422.148954:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612422.148958:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788612422.148960:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612422.148961:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612422.148963:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612422.148964:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612422.148965:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612422.148966:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612422.148967:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612422.148968:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612422.148969:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612422.148970:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612422.148977:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612422.149191:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788612422.149210:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932151680:0@lo:253: 00000100:00100000:0.0:1788612422.149288:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.149440:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c7278780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612422.149637:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151680 00000100:00100000:1.0:1788612422.149645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151680 00000100:00100000:1.0:1788612422.149717:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788612422.149725:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8432:x1875495932151680:12345-0@lo:253: 20000000:01000000:1.0:1788612422.149752:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788612422.149756:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788612422.149760:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788612422.149764:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788612422.149932:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612422.150062:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788612422.150075:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788612422.150090:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788612422.150094:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788612422.150173:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788612422.150190:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788612422.150267:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788612422.150281:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:1.0:1788612422.150284:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1788612422.150297:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788612422.150303:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788612422.150317:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788612422.150322:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1788612422.150333:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788612422.150338:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788612422.150348:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788612422.150360:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788612422.150421:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788612422.150432:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:1.0:1788612422.150434:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1788612422.150448:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788612422.150453:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788612422.150465:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788612422.150469:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1788612422.150505:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788612422.150511:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788612422.150525:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788612422.150540:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788612422.150962:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788612422.150971:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:1.0:1788612422.150973:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1788612422.150984:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788612422.150988:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788612422.151013:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788612422.151018:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1788612422.151034:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788612422.151038:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788612422.151048:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788612422.151060:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788612422.151070:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788612422.151073:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788612422.151076:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788612422.151113:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788612422.151116:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788612422.151866:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788612422.151904:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788612422.151926:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788612422.152272:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788612422.152292:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788612422.152305:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1788612422.152314:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788612422.152316:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788612422.152666:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788612422.152683:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788612422.152694:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788612422.152834:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788612422.152854:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788612422.152869:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788612422.152877:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788612422.152879:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788612422.153335:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788612422.153360:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788612422.153378:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788612422.153679:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788612422.153702:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788612422.153717:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788612422.153727:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788612422.153729:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788612422.154218:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788612422.154372:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788612422.154394:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788612422.154411:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1788612422.154425:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788612422.154443:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154462:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154638:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154645:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154652:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154658:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154665:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154702:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154716:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 18 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.154729:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932151808:0@lo:104: 00000100:00100000:1.0:1788612422.154800:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612422.154894:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.154903:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 18 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.154912:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932151936:0@lo:104: 00000100:00100000:1.0:1788612422.154940:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612422.155140:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.155149:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 18 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.155157:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932152064:0@lo:104: 00000100:00100000:1.0:1788612422.155179:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.155307:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151808 00000100:00100000:0.0:1788612422.155313:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151808 00000100:00100000:0.0:1788612422.155349:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932151936 00000100:00100000:0.0:1788612422.155353:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932151936 00000100:00100000:0.0:1788612422.155368:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612422.155375:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6516:x1875495932151808:12345-0@lo:104: 00010000:00010000:0.0:1788612422.155388:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.155444:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612422.155450:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6516:x1875495932151808:12345-0@lo:104: Request processed in 76us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.155457:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612422.155499:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612422.155507:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932151936:12345-0@lo:104: 00010000:00010000:0.0:1788612422.155515:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.155547:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612422.155553:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932151936:12345-0@lo:104: Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.155558:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788612422.155636:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612422.155643:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155650:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4400 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612422.155654:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155663:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612422.155670:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612422.155675:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612422.155708:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155715:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612422.155729:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155735:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cf6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155756:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612422.155760:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155765:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612422.155768:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155774:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612422.155780:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612422.155785:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612422.155799:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155804:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612422.155814:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155820:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897e00/0x1f8616bf0bc7cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.155829:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612422.155830:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612422.155832:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612422.155896:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932152192:0@lo:103: 00000100:00100000:0.0:1788612422.155939:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.156007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932152320:0@lo:103: 00000100:00100000:0.0:1788612422.156040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.156071:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152192 00000100:00100000:0.0:1788612422.156075:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152192 00010000:00010000:0.0:1788612422.156092:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 19 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612422.156113:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152320 00000100:00100000:0.0:1788612422.156116:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152320 00010000:00010000:0.0:1788612422.156140:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 20 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612422.156165:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612422.156172:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3649:x1875495932152192:12345-0@lo:103: 00010000:00010000:0.0:1788612422.156182:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612422.156186:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 20 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.156196:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 20 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.156211:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612422.156239:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3649:x1875495932152192:12345-0@lo:103: Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.156245:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612422.156258:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612422.156264:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932152320:12345-0@lo:103: 00010000:00010000:0.0:1788612422.156272:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612422.156276:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 19 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.156290:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 19 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.156299:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612422.156324:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932152320:12345-0@lo:103: Request processed in 60us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.156329:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612422.156358:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932152320:0@lo:103: 00000100:00100000:0.0:1788612422.156379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932152192:0@lo:103: 00010000:00010000:0.0:1788612422.156696:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612422.156881:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.156891:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 18 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.156900:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe977800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932152448:0@lo:104: 00000100:00100000:1.0:1788612422.156926:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612422.157007:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.157025:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 18 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.157034:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932152576:0@lo:104: 00000100:00100000:1.0:1788612422.157056:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.157219:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152064 00000100:00100000:0.0:1788612422.157224:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152064 00000100:00100000:0.0:1788612422.157247:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152448 00000100:00100000:0.0:1788612422.157251:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152448 00000100:00100000:0.0:1788612422.157263:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612422.157270:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6516:x1875495932152064:12345-0@lo:104: 00010000:00010000:0.0:1788612422.157280:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157327:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612422.157333:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6516:x1875495932152064:12345-0@lo:104: Request processed in 63us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.157341:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612422.157354:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612422.157361:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932152448:12345-0@lo:104: 00010000:00010000:0.0:1788612422.157368:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157423:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612422.157429:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932152448:12345-0@lo:104: Request processed in 69us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.157435:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788612422.157452:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612422.157457:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157464:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896400 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612422.157467:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157496:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612422.157503:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612422.157508:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612422.157532:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157537:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612422.157548:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157555:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cb0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157576:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612422.157580:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157585:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612422.157588:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157596:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612422.157601:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612422.157606:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612422.157628:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157634:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612422.157646:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157652:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc7c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c78 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157662:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612422.157663:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612422.157665:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612422.157675:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932152704:0@lo:103: 00000100:00100000:0.0:1788612422.157709:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.157743:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932152832:0@lo:103: 00000100:00100000:0.0:1788612422.157764:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.157791:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152704 00000100:00100000:0.0:1788612422.157795:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152704 00010000:00010000:0.0:1788612422.157811:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 19 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612422.157829:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152832 00000100:00100000:0.0:1788612422.157832:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152832 00010000:00010000:0.0:1788612422.157840:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 20 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612422.157861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612422.157868:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3651:x1875495932152704:12345-0@lo:103: 00010000:00010000:0.0:1788612422.157877:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612422.157882:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 20 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157891:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 20 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157903:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612422.157928:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3651:x1875495932152704:12345-0@lo:103: Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.157934:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612422.157946:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612422.157952:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3648:x1875495932152832:12345-0@lo:103: 00010000:00010000:0.0:1788612422.157958:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612422.157969:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 19 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157978:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 19 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.157988:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612422.158183:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612422.158241:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3648:x1875495932152832:12345-0@lo:103: Request processed in 289us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.158247:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612422.158281:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932152832:0@lo:103: 00000100:00100000:0.0:1788612422.158300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932152704:0@lo:103: 00000100:00100000:1.0:1788612422.158799:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb5240 going to sleep for 11 seconds 00010000:00010000:1.0:1788612422.158815:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030e00/0x1f8616bf0bc7cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7cef expref: 18 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.158825:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932151808:0@lo:104: 00010000:00010000:1.0:1788612422.158841:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7cc5 expref: 17 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.158851:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932151936:0@lo:104: 00010000:00010000:1.0:1788612422.158858:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc7cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7ca9 expref: 16 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.158865:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932152064:0@lo:104: 00010000:00010000:1.0:1788612422.158872:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897c00/0x1f8616bf0bc7c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7c71 expref: 15 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.158879:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe977800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932152448:0@lo:104: 00000100:00100000:2.0:1788612422.158919:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152576 00000100:00100000:2.0:1788612422.158924:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152576 00000100:00100000:0.0:1788612422.158963:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612422.158971:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932152576:12345-0@lo:104: 00010000:00010000:0.0:1788612422.158981:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159181:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612422.159187:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6516:x1875495932152576:12345-0@lo:104: Request processed in 218us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.159194:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788612422.159210:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612422.159214:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159220:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612422.159224:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159242:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612422.159249:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612422.159255:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612422.159277:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159282:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612422.159292:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159298:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c0030800/0x1f8616bf0bc7bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7c01 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159310:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612422.159312:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612422.159314:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612422.159323:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612422.159331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932152960:0@lo:103: 00000100:00100000:0.0:1788612422.159359:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.159378:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932152960 00000100:00100000:0.0:1788612422.159381:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932152960 00010000:00010000:0.0:1788612422.159394:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 15 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612422.159413:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612422.159418:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9285450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3648:x1875495932152960:12345-0@lo:103: 00010000:00010000:0.0:1788612422.159432:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612422.159438:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 15 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159447:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 15 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159461:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159469:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159510:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159517:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159523:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159530:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159535:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612422.159539:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159546:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159565:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.159575:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612422.159600:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9285450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3648:x1875495932152960:12345-0@lo:103: Request processed in 182us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.159606:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612422.159658:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932152960:0@lo:103: 00010000:00010000:1.0:1788612422.159723:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc7c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7bfa expref: 14 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.159733:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875495932152576:0@lo:104: 00010000:00010000:1.0:1788612422.159751:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.159759:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.159765:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.159771:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc7d35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788612422.159782:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788612422.163383:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:8432:x1875495932151680:12345-0@lo:253: Request processed in 13647us (14084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.163398:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788612422.163525:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932151680:0@lo:253: 10000000:01000000:0.0:1788612422.163539:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788612422.163542:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612422.163544:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612422.163546:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612422.163547:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788612422.163548:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612422.163549:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612422.163550:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612422.163552:0:8432:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788612422.163553:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612422.163554:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612422.163578:0:8432:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9612fcfb4000 from lustre-OST0000 10000000:01000000:0.0:1788612422.163605:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788612422.163608:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788612422.163624:0:8432:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9612d1e64d40 local copy 10000000:01000000:0.0:1788612422.163629:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788612422.163661:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.163672:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.163701:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612422.163720:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153088:0@lo:101: 00000100:00100000:0.0:1788612422.165689:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.165778:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c7278600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612422.166260:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153088 00000100:00100000:2.0:1788612422.166269:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153088 00000100:00100000:2.0:1788612422.166348:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788612422.166358:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+13:8432:x1875495932153088:12345-0@lo:101: 00010000:00010000:2.0:1788612422.166372:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612422.166390:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc7d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612422.166443:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d3c expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612422.166454:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d3c expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612422.166463:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1a00, rc 0) 00000100:00100000:2.0:1788612422.166551:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153088:12345-0@lo:101: Request processed in 194us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612422.166557:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612422.166645:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153088:0@lo:101: 00010000:00010000:1.0:1788612422.166661:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.166670:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.166773:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153216:0@lo:501: 00000100:00100000:1.0:1788612422.166803:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.167228:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.167305:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153216 00000100:00100000:0.0:1788612422.167310:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153216 00000100:00100000:0.0:1788612422.167335:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612422.167342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153216:12345-0@lo:501: 00000100:00100000:0.0:1788612422.167413:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153216:12345-0@lo:501: Request processed in 71us (608us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612422.167420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788612422.167542:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153216:0@lo:501: 10000000:01000000:1.0:1788612422.167556:0:8432:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788612422.167575:0:8432:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788612422.167581:0:8432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.167590:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.167598:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.167628:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788612422.167651:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612fcfb4000 10000000:01000000:1.0:1788612422.167656:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612422.167670:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788612422.167673:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612422.167678:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788612422.167680:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612422.167703:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.167710:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.167718:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.167730:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153344:0@lo:101: 00000100:00100000:1.0:1788612422.167756:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.167767:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.167809:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153344 00000100:00100000:0.0:1788612422.167814:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153344 00000100:00100000:0.0:1788612422.167843:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612422.167849:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153344:12345-0@lo:101: 00010000:00010000:0.0:1788612422.167857:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612422.167867:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7d4a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.167884:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.167893:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.167900:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030a00, rc 0) 00000100:00100000:0.0:1788612422.167948:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932153344:12345-0@lo:101: Request processed in 98us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.167954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1788612422.167987:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612422.168002:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.168009:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612422.168019:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.168028:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612422.168035:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612422.168040:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612422.168059:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.168065:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612422.168081:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.168088:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c0031000/0x1f8616bf0bc7d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7d43 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.168101:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612422.168102:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612422.168103:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612422.168120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932153472:0@lo:103: 00000100:00100000:0.0:1788612422.168147:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.168185:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153472 00000100:00100000:0.0:1788612422.168189:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153472 00000100:00100000:0.0:1788612422.168218:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612422.168226:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3650:x1875495932153472:12345-0@lo:103: 00010000:00010000:0.0:1788612422.168234:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612422.168246:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc7d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc7d3c expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.168255:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612422.168282:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:3650:x1875495932153472:12345-0@lo:103: Request processed in 57us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.168287:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612422.168314:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932153472:0@lo:103: 00000100:00100000:1.0:1788612422.168646:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153344:0@lo:101: 00010000:00010000:1.0:1788612422.168659:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.168668:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.168742:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153600:0@lo:501: 00000100:00100000:1.0:1788612422.168769:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.168786:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.169239:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153600 00000100:00100000:0.0:1788612422.169246:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153600 00000100:00100000:0.0:1788612422.169279:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612422.169286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153600:12345-0@lo:501: 00000100:00100000:0.0:1788612422.169404:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153600:12345-0@lo:501: Request processed in 117us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.169411:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788612422.169565:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153600:0@lo:501: 00000100:00100000:1.0:1788612422.169595:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153728:0@lo:503: 00000100:00100000:1.0:1788612422.169658:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.169675:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.169723:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153728 00000100:00100000:0.0:1788612422.169728:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153728 00000100:00100000:0.0:1788612422.169746:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788612422.169751:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153728:12345-0@lo:503: 00000100:00100000:0.0:1788612422.169839:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153728:12345-0@lo:503: Request processed in 87us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.169852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612422.169921:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153728:0@lo:503: 00000040:00080000:1.0:1788612422.170301:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612422.170366:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153856:0@lo:502: 00000100:00100000:1.0:1788612422.170406:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.170437:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.171581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153856 00000100:00100000:0.0:1788612422.171593:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153856 00000100:00100000:0.0:1788612422.171640:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788612422.171649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153856:12345-0@lo:502: 00000100:00100000:0.0:1788612422.171784:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153856:12345-0@lo:502: Request processed in 135us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.171791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612422.171879:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153856:0@lo:502: 00000040:00080000:1.0:1788612422.172174:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788612422.172203:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788612422.172217:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788612422.172229:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788612422.172241:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788612422.172256:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788612422.172284:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153984:0@lo:502: 00000100:00100000:1.0:1788612422.172328:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.172358:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.172407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932153984 00000100:00100000:0.0:1788612422.172411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932153984 00000100:00100000:0.0:1788612422.172444:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788612422.172451:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153984:12345-0@lo:502: 00000100:00100000:0.0:1788612422.172548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932153984:12345-0@lo:502: Request processed in 96us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.172554:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788612422.172764:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932153984:0@lo:502: 00000040:00080000:1.0:1788612422.172804:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788612422.172812:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788612422.174298:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612422.174308:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788612422.174314:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612422.174316:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788612422.174322:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612422.174337:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9612fb85cd40) 00000020:00000080:0.0:1788612422.174358:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788612422.174364:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788612422.174451:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612fcfb4000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788612422.174458:0:8455:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788612422.174464:0:8455:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1f8616bf0bc7d5f 00010000:00010000:0.0:1788612422.185029:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788612422.185326:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788612422.190707:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788612422.191075:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788612422.196229:0:8455:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788612422.196975:0:8455:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788612422.208736:0:8455:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788612422.209812:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788612422.209824:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612422.209831:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612422.209833:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788612422.209837:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612422.209842:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612422.209843:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788612422.209846:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788612422.209848:0:8455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788612422.209869:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612422.209873:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612422.209874:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788612422.209877:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788612422.211884:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788612422.211923:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788612422.211943:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.211955:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612422.211975:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fcfb4000 from 1 10000000:01000000:1.0:1788612422.211978:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612422.212015:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.212023:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.212034:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.212056:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154112:0@lo:101: 00000100:00100000:1.0:1788612422.212118:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.212163:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.212243:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154112 00000100:00100000:0.0:1788612422.212251:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154112 00000100:00100000:0.0:1788612422.212299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788612422.212307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932154112:12345-0@lo:101: 00010000:00010000:0.0:1788612422.212319:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612422.212331:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7d66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.212354:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.212364:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.212383:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031000, rc 0) 00000100:00100000:0.0:1788612422.212596:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154112:12345-0@lo:101: Request processed in 289us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.212604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788612422.215207:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154112:0@lo:101: 00010000:00010000:1.0:1788612422.215232:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.215244:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.215356:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154240:0@lo:501: 00000100:00100000:1.0:1788612422.215419:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.215593:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612422.215667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154240 00000100:00100000:2.0:1788612422.215674:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154240 00000100:00100000:2.0:1788612422.215723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612422.215733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154240:12345-0@lo:501: 00000100:00100000:2.0:1788612422.215842:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154240:12345-0@lo:501: Request processed in 110us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612422.215849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788612422.215950:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154240:0@lo:501: 00000100:00100000:1.0:1788612422.215979:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154368:0@lo:503: 00000100:00100000:1.0:1788612422.216028:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.216085:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.218331:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154368 00000100:00100000:0.0:1788612422.218346:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154368 00000100:00100000:0.0:1788612422.219805:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788612422.219821:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154368:12345-0@lo:503: 00000100:00100000:0.0:1788612422.219988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154368:12345-0@lo:503: Request processed in 171us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.219995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788612422.220122:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154368:0@lo:503: 00000040:00080000:2.0:1788612422.220357:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612422.220463:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154496:0@lo:502: 00000100:00100000:2.0:1788612422.220537:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612422.220565:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d136b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.222757:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154496 00000100:00100000:0.0:1788612422.222771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154496 00000100:00100000:0.0:1788612422.222835:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788612422.222845:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154496:12345-0@lo:502: 00000100:00100000:0.0:1788612422.223007:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154496:12345-0@lo:502: Request processed in 163us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.223015:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788612422.223160:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154496:0@lo:502: 00000040:00080000:2.0:1788612422.223433:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788612422.223466:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788612422.223532:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154624:0@lo:502: 00000100:00100000:2.0:1788612422.223583:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612422.223607:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d136b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612422.223687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154624 00000100:00100000:1.0:1788612422.223693:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154624 00000100:00100000:1.0:1788612422.223725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788612422.223733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154624:12345-0@lo:502: 00000100:00100000:1.0:1788612422.223827:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154624:12345-0@lo:502: Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.223835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612422.224031:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154624:0@lo:502: 00000040:00080000:2.0:1788612422.224073:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788612422.224081:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788612422.224594:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612422.224603:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612422.224606:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788612422.224612:0:8459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612fcfb4000 00000020:00000080:2.0:1788612422.224627:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612422.224640:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612422.224643:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612422.224645:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788612422.224647:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788612422.224764:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788612422.224788:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612422.224810:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.224821:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612422.224865:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788612422.224868:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612fcfb4000 10000000:01000000:1.0:1788612422.224871:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612fcfb4000 10000000:01000000:1.0:1788612422.224875:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612422.224880:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fcfb4000 from 1 10000000:01000000:1.0:1788612422.224883:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612422.224908:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.224916:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.224926:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.224948:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe977800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154752:0@lo:101: 00000100:00100000:1.0:1788612422.224989:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.225015:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612422.228676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154752 00000100:00100000:2.0:1788612422.228687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154752 00000100:00100000:2.0:1788612422.228734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788612422.228742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8432:x1875495932154752:12345-0@lo:101: 00010000:00010000:2.0:1788612422.228758:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612422.228774:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7d74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612422.228799:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612422.228809:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612422.228818:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0000, rc 0) 00000100:00100000:2.0:1788612422.228891:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932154752:12345-0@lo:101: Request processed in 149us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612422.228911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612422.229053:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe977800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154752:0@lo:101: 00010000:00010000:3.0:1788612422.229073:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.229084:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612422.229241:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154880:0@lo:501: 00000100:00100000:3.0:1788612422.229275:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612422.229309:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612422.229415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932154880 00000100:00100000:2.0:1788612422.229421:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932154880 00000100:00100000:2.0:1788612422.229801:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788612422.229810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932154880:12345-0@lo:501: 00000100:00100000:2.0:1788612422.229926:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932154880:12345-0@lo:501: Request processed in 117us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612422.229933:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788612422.229996:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932154880:0@lo:501: 00000100:00100000:3.0:1788612422.230026:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932155008:0@lo:503: 00000100:00100000:3.0:1788612422.230067:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.232371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155008 00000100:00100000:0.0:1788612422.232397:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155008 00000100:00100000:0.0:1788612422.232640:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.235643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788612422.235657:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932155008:12345-0@lo:503: 00000100:00100000:0.0:1788612422.235842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932155008:12345-0@lo:503: Request processed in 188us (5773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.235850:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788612422.235932:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932155008:0@lo:503: 00000040:00080000:0.0:1788612422.236194:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612422.236268:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932155136:0@lo:502: 00000100:00100000:0.0:1788612422.236313:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.236343:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155136 00000100:00100000:0.0:1788612422.236349:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155136 00000100:00100000:0.0:1788612422.236369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788612422.236376:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932155136:12345-0@lo:502: 00000100:00100000:0.0:1788612422.236472:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932155136:12345-0@lo:502: Request processed in 96us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.236500:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788612422.236543:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.236556:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932155136:0@lo:502: 00000040:00080000:0.0:1788612422.236730:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788612422.236755:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788612422.236768:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788612422.236780:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788612422.236791:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788612422.236802:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788612422.236813:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788612422.236825:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788612422.236838:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788612422.236851:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788612422.236864:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788612422.236875:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788612422.236889:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788612422.236899:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788612422.236910:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788612422.236920:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788612422.236942:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788612422.236955:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788612422.236967:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788612422.236978:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788612422.236990:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788612422.237003:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788612422.237017:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788612422.237046:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788612422.237063:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788612422.237075:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788612422.237088:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788612422.237102:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788612422.237115:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788612422.237127:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788612422.237141:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788612422.237154:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788612422.237166:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788612422.237179:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788612422.237191:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788612422.237202:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788612422.237216:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788612422.237240:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932155264:0@lo:502: 00000100:00100000:0.0:1788612422.237283:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.237312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155264 00000100:00100000:0.0:1788612422.237316:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155264 00000100:00100000:0.0:1788612422.237337:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612422.237343:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932155264:12345-0@lo:502: 00000100:00100000:0.0:1788612422.237427:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932155264:12345-0@lo:502: Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.237433:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612422.237465:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612422.237505:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932155264:0@lo:502: 00000040:00080000:0.0:1788612422.237543:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788612422.237551:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788612422.239200:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788612422.239225:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9611c64bb380) 00000020:00000080:2.0:1788612422.239248:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788612422.239334:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612fcfb4000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612422.239339:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fcfb4000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612422.239341:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fcfb4000 3 00010000:00080000:2.0:1788612422.239369:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c6491000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612422.241876:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788612422.242138:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788612422.242180:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612422.242193:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1f8616bf0bc7d89 00000100:00080000:2.0:1788612422.242203:0:8460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612422.242209:0:8460:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c6491000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612422.242242:0:8460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612c8ed1180 x1875495932155392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612422.242302:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932155392:0@lo:38: 00000100:00100000:0.0:1788612422.242369:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.242499:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155392 00000100:00100000:1.0:1788612422.242506:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155392 00000100:00100000:1.0:1788612422.242539:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612422.242547:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932155392:12345-0@lo:38: 00010000:00080000:1.0:1788612422.242569:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:1.0:1788612422.242611:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1f8616bf0bc7d90 00000004:00100000:1.0:1788612422.242638:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788612422.242667:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9612fe9f4800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788612422.242738:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788612422.247624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932155776:0@lo:400: 00000100:00100000:3.0:1788612422.247699:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612422.247737:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612422.247744:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932155648:0@lo:400: 00000100:00100000:3.0:1788612422.247787:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612422.247826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932155904:0@lo:400: 00000100:00100000:3.0:1788612422.247850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612422.247873:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612422.247879:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932155520:0@lo:400: 00000100:00100000:3.0:1788612422.247900:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.248706:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875495932155392:12345-0@lo:38: Request processed in 6153us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.248717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612422.248744:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155776 00000100:00100000:1.0:1788612422.248751:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155776 00000100:00100000:1.0:1788612422.248780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155520 00000100:00100000:1.0:1788612422.248783:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155520 00000100:00100000:1.0:1788612422.248798:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612422.248806:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932155776:12345-0@lo:400: 00000100:00100000:1.0:1788612422.248906:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932155776:12345-0@lo:400: Request processed in 100us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.248912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612422.248926:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612422.248933:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932155520:12345-0@lo:400: 00000100:00100000:1.0:1788612422.248970:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932155520:12345-0@lo:400: Request processed in 37us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.248984:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788612422.249138:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612c8ed3480 x1875495932155520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612422.249152:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932155520:0@lo:400: 00000020:01000004:2.0:1788612422.250366:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788612422.250384:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9611c64b8000) 00000020:00000080:2.0:1788612422.250404:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00010000:00080000:0.0:1788612422.251637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612c8ed1180 x1875495932155392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612422.251651:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612422.251662:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788612422.251672:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612422.251677:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612422.251682:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612422.251688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932155392:0@lo:38: 00000100:00100000:0.0:1788612422.251738:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155648 00000100:00100000:0.0:1788612422.251744:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155648 00000100:00100000:0.0:1788612422.251779:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932155904 00000100:00100000:0.0:1788612422.251782:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932155904 00000100:00100000:0.0:1788612422.251799:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612422.251807:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932155648:12345-0@lo:400: 00000100:00100000:0.0:1788612422.251883:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932155648:12345-0@lo:400: Request processed in 76us (4095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.251890:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612422.251905:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612422.251911:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932155904:12345-0@lo:400: 00000100:00100000:0.0:1788612422.251947:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932155904:12345-0@lo:400: Request processed in 36us (4097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612422.251965:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612422.252071:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932155904:0@lo:400: 00000020:01000004:2.0:1788612422.252907:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612fcfb4000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612422.252912:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fcfb4000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612422.252914:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fcfb4000 3 00010000:00080000:2.0:1788612422.252946:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c6490000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00080000:3.0:1788612422.254719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612c8ed1f80 x1875495932155776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612422.254737:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932155776:0@lo:400: 00000100:00100000:3.0:1788612422.254785:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932155648:0@lo:400: 00010000:00010000:2.0:1788612422.256269:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788612422.256751:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788612422.256796:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612422.256812:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1f8616bf0bc7d9e 00000100:00080000:2.0:1788612422.256823:0:8460:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612422.256830:0:8460:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9611c6490000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612422.256865:0:8460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612c8ed2680 x1875495932156032/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612422.256919:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932156032:0@lo:38: 00000100:00100000:0.0:1788612422.256988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612422.257054:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788612422.257138:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156032 00000100:00100000:3.0:1788612422.257146:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156032 00000100:00100000:3.0:1788612422.257187:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612422.257195:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932156032:12345-0@lo:38: 00010000:00080000:3.0:1788612422.257219:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1788612422.257249:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1f8616bf0bc7da5 00000004:00100000:3.0:1788612422.257263:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612422.257294:0:6525:0:(import.c:65:import_set_state_nolock()) ffff96130066b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612422.262258:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875495932156032:12345-0@lo:38: Request processed in 5052us (5260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612422.262273:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788612422.262367:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612c8ed2680 x1875495932156032/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612422.262380:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000040:00080000:3.0:1788612422.262845:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788612422.262993:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788612422.263001:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612422.263006:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788612422.263009:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6490000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612422.263017:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932156032:0@lo:38: 00000020:01000000:0.0:1788612422.263055:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788612422.263081:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612422.263104:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612422.263114:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788612422.263163:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788612422.263166:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612422.263167:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612422.263168:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612422.263170:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612422.263171:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612422.263172:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612422.263173:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612422.263175:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612422.263177:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612422.263182:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612422.263186:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788612422.263188:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612422.263190:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612422.263191:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612422.263191:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612422.263192:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612422.263193:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612422.263194:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612422.263195:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612422.263196:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612422.263197:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612422.263197:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612422.263217:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788612422.263231:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932156160:0@lo:253: 00000100:00100000:0.0:1788612422.263291:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612422.263323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156160 00000100:00100000:0.0:1788612422.263328:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156160 00000100:00100000:0.0:1788612422.263364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788612422.263372:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:8432:x1875495932156160:12345-0@lo:253: 20000000:01000000:0.0:1788612422.263396:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788612422.263410:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788612422.263641:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03cc0 going to sleep for 11 seconds 20000000:01000000:1.0:1788612422.271679:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788612422.271698:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788612422.271830:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612422.271835:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612422.271856:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.271874:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.271882:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.271889:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.271928:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.271957:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 16 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612422.271970:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932156288:0@lo:104: 00000100:00100000:3.0:1788612422.272035:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612422.272093:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612422.272101:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 16 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612422.272110:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932156416:0@lo:104: 00000100:00100000:3.0:1788612422.272129:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612422.275555:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788612422.275601:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.275650:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156288 00000100:00100000:1.0:1788612422.275658:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156288 00000100:00100000:1.0:1788612422.275697:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156416 00000100:00100000:1.0:1788612422.275700:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156416 00000100:00100000:1.0:1788612422.275712:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612422.275720:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613007ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6539:x1875495932156288:12345-0@lo:104: 00010000:00010000:1.0:1788612422.275737:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.275807:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612422.275813:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613007ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6539:x1875495932156288:12345-0@lo:104: Request processed in 94us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.275821:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612422.275857:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612422.275864:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932156416:12345-0@lo:104: 00010000:00010000:1.0:1788612422.275872:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.275925:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612422.275931:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932156416:12345-0@lo:104: Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.275937:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788612422.275961:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612422.275967:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.275974:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612422.275979:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.275988:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612422.275994:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612422.276000:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612422.276036:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276043:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612422.276060:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276066:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc7cb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7cbe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276090:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612422.276093:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276099:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612422.276102:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276108:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612422.276115:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612422.276120:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612422.276133:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276139:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612422.276152:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276159:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f4e00/0x1f8616bf0bc7c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ca2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276173:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612422.276175:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612422.276177:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612422.276183:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612422.276202:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932156544:0@lo:103: 00000100:00100000:1.0:1788612422.276232:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.276266:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932156672:0@lo:103: 00000100:00100000:1.0:1788612422.276284:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.276323:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156544 00000100:00100000:1.0:1788612422.276326:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156544 00010000:00010000:1.0:1788612422.276342:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 17 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.276359:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156672 00000100:00100000:1.0:1788612422.276361:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156672 00010000:00010000:1.0:1788612422.276369:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 18 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.276384:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612422.276390:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3651:x1875495932156544:12345-0@lo:103: 00010000:00010000:1.0:1788612422.276400:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612422.276405:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 18 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276414:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 18 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276429:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612422.276456:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3651:x1875495932156544:12345-0@lo:103: Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.276462:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612422.276492:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612422.276499:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:3648:x1875495932156672:12345-0@lo:103: 00010000:00010000:1.0:1788612422.276514:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612422.276519:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 17 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276527:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 17 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276539:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276546:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788612422.276559:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016303027s 00010000:00010000:1.0:1788612422.276563:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276570:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276576:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276582:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276588:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612422.276592:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276599:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276612:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276632:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612422.276660:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:3648:x1875495932156672:12345-0@lo:103: Request processed in 161us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.276666:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612422.276710:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932156672:0@lo:103: 00000100:00100000:1.0:1788612422.276729:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932156544:0@lo:103: 00010000:00010000:1.0:1788612422.276748:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7cb7 expref: 16 pid: 6518 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.276756:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932156288:0@lo:104: 00010000:00010000:1.0:1788612422.276764:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc7ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7c9b expref: 15 pid: 6516 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612422.276771:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932156416:0@lo:104: 00010000:00010000:1.0:1788612422.276784:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276792:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276798:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612422.276804:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7dac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612422.276933:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:8432:x1875495932156160:12345-0@lo:253: Request processed in 13561us (13640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612422.276941:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788612422.277259:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:8432:1875495932156160:0@lo:253: 10000000:01000000:1.0:1788612422.277269:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788612422.277272:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612422.277273:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788612422.277275:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612422.277276:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612422.277277:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612422.277278:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612422.277280:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612422.277281:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612422.277283:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612422.277284:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612422.277286:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788612422.277297:0:8432:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788612422.287111:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788612422.287283:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788612422.287755:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788612422.287911:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788612422.288165:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788612422.291909:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788612422.301864:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788612422.317421:0:8432:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788612422.317430:0:8432:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788612422.317470:0:8432:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612422.317541:0:8432:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612422.317560:0:8432:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788612422.317588:0:8432:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788612422.318329:0:8432:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612422.318529:0:8432:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788612423.027109:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788612423.402097:0:8516:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612423.402312:0:8516:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788612423.543626:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612423.543634:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fccf8000 from 30 10000000:01000000:0.0:1788612423.543639:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612423.543686:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.543697:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.543708:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.543730:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932156800:0@lo:101: 00000100:00100000:0.0:1788612423.543796:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.543850:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612423.545751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156800 00000100:00100000:2.0:1788612423.545763:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156800 00000100:00100000:2.0:1788612423.545824:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788612423.545836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:6520:x1875495932156800:12345-0@lo:101: 00010000:00010000:2.0:1788612423.545851:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612423.545869:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7db3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612423.545894:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612423.545906:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612423.545927:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0e00, rc 0) 00000100:00100000:2.0:1788612423.545995:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932156800:12345-0@lo:101: Request processed in 161us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.547377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788612423.547698:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932156800:0@lo:101: 00010000:00010000:2.0:1788612423.547722:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612423.547733:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612423.547811:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932156928:0@lo:501: 00000100:00100000:2.0:1788612423.547857:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612423.547900:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612423.547994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932156928 00000100:00100000:3.0:1788612423.548001:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932156928 00000100:00100000:3.0:1788612423.548041:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788612423.548053:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932156928:12345-0@lo:501: 00000100:00100000:3.0:1788612423.548323:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932156928:12345-0@lo:501: Request processed in 272us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612423.548332:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788612423.549121:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932156928:0@lo:501: 00000100:00100000:0.0:1788612423.549160:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157056:0@lo:503: 00000100:00100000:0.0:1788612423.549207:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.549241:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612423.549929:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157056 00000100:00100000:2.0:1788612423.549936:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157056 00000100:00100000:2.0:1788612423.549981:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788612423.549990:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932157056:12345-0@lo:503: 00000100:00100000:2.0:1788612423.550110:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932157056:12345-0@lo:503: Request processed in 120us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.550117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788612423.550167:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157056:0@lo:503: 00000100:00100000:2.0:1788612423.550327:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8526:1875495932157184:0@lo:502: 00000100:00100000:2.0:1788612423.550376:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612423.550399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157184 00000100:00100000:2.0:1788612423.550872:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157184 00000100:00100000:2.0:1788612423.550915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788612423.550923:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8526:x1875495932157184:12345-0@lo:502: 00000100:00100000:2.0:1788612423.551106:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8526:x1875495932157184:12345-0@lo:502: Request processed in 183us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.551114:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788612423.551166:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612423.551180:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8526:1875495932157184:0@lo:502: 00000100:00100000:2.0:1788612423.551223:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8526:1875495932157312:0@lo:502: 00000100:00100000:2.0:1788612423.551259:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612423.554882:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.556112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157312 00000100:00100000:0.0:1788612423.556124:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157312 00000100:00100000:0.0:1788612423.556248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788612423.556260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8526:x1875495932157312:12345-0@lo:502: 00000100:00100000:0.0:1788612423.556588:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:8526:x1875495932157312:12345-0@lo:502: Request processed in 328us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.556596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788612423.557977:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8526:1875495932157312:0@lo:502: 00000040:00080000:2.0:1788612423.558032:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788612423.558257:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788612423.558280:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612423.558289:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558313:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612423.558324:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612423.558327:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612fccf8000 from 5 10000000:01000000:0.0:1788612423.558330:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612423.558362:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558369:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558378:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.558396:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157440:0@lo:101: 00000100:00100000:0.0:1788612423.558498:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.558533:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.558551:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157440 00000100:00100000:0.0:1788612423.558557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157440 00000100:00100000:0.0:1788612423.558593:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788612423.558617:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932157440:12345-0@lo:101: 00010000:00010000:0.0:1788612423.558628:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612423.558642:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7dc1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558663:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558687:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558700:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030800, rc 0) 00000100:00100000:0.0:1788612423.558738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932157440:12345-0@lo:101: Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.558744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788612423.558783:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157440:0@lo:101: 00010000:00010000:0.0:1788612423.558795:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.558804:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.558856:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157568:0@lo:256: 00000100:00100000:0.0:1788612423.558885:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.558901:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.558916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157568 00000100:00100000:0.0:1788612423.558920:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157568 00000100:00100000:0.0:1788612423.558947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788612423.558954:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932157568:12345-0@lo:256: 20000000:01000000:0.0:1788612423.558967:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612423.558982:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612423.558985:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788612423.561045:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932157568:12345-0@lo:256: Request processed in 2086us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.561057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788612423.561124:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157568:0@lo:256: 10000000:01000000:0.0:1788612423.561177:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612423.561187:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.561198:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612423.561205:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788612423.561208:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788612423.561210:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788612423.561239:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.561246:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.561255:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.561271:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157696:0@lo:101: 00000100:00100000:0.0:1788612423.561301:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.561334:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.562755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157696 00000100:00100000:0.0:1788612423.562765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157696 00000100:00100000:0.0:1788612423.562807:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788612423.562816:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932157696:12345-0@lo:101: 00010000:00010000:0.0:1788612423.562831:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612423.562847:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7dcf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.562878:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.562888:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.562897:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961302171e00, rc 0) 00000100:00100000:0.0:1788612423.562948:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932157696:12345-0@lo:101: Request processed in 132us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.562954:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788612423.562997:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157696:0@lo:101: 00010000:00010000:0.0:1788612423.563012:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.563021:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.563084:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157824:0@lo:501: 00000100:00100000:0.0:1788612423.563113:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.563129:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.563141:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157824 00000100:00100000:0.0:1788612423.563144:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157824 00000100:00100000:0.0:1788612423.563164:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788612423.563169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932157824:12345-0@lo:501: 00000100:00100000:0.0:1788612423.563275:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932157824:12345-0@lo:501: Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.563281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788612423.563315:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157824:0@lo:501: 00000100:00100000:0.0:1788612423.563341:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157952:0@lo:503: 00000100:00100000:0.0:1788612423.563379:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.563392:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.563403:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932157952 00000100:00100000:0.0:1788612423.563407:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932157952 00000100:00100000:0.0:1788612423.563424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788612423.563447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932157952:12345-0@lo:503: 00000100:00100000:0.0:1788612423.563542:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932157952:12345-0@lo:503: Request processed in 111us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.563549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788612423.563589:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932157952:0@lo:503: 00000100:00100000:3.0:1788612423.566063:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8527:1875495932158080:0@lo:502: 00000100:00100000:3.0:1788612423.566133:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612423.566176:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.566187:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158080 00000100:00100000:0.0:1788612423.566196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158080 00000100:00100000:0.0:1788612423.566235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788612423.566244:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8527:x1875495932158080:12345-0@lo:502: 00000100:00100000:0.0:1788612423.566371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8527:x1875495932158080:12345-0@lo:502: Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.566379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788612423.566624:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8527:1875495932158080:0@lo:502: 00000020:01000000:3.0:1788612423.566652:0:8527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788612423.566664:0:8527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788612423.566670:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612423.566673:0:8527:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788612423.566680:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612423.566683:0:8527:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788612423.566704:0:8527:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788612423.566706:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612423.566720:0:8527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9612ea24b380) 00000020:00000080:3.0:1788612423.566739:0:8527:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788612423.566744:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612423.566816:0:8527:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788612423.566823:0:8527:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788612423.566829:0:8527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc7de4 00010000:00080000:3.0:1788612423.566863:0:8527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612c92f1800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612423.567197:0:8527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788612423.593202:0:8527:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788612423.593232:0:8527:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788612423.605355:0:8527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612423.605799:0:8527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612423.605871:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788612423.605949:0:8527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788612423.610842:0:8532:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612423.610850:0:8532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788612423.626827:0:8527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788612423.626842:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788612423.626885:0:8527:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788612423.626909:0:8527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7deb 00000100:00080000:0.0:1788612423.626919:0:8527:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612423.626925:0:8527:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9612c92f1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612423.626959:0:8527:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fb850a80 x1875495932158208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612423.626986:0:8527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788612423.627182:0:8527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612423.627187:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612423.627189:0:8527:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788612423.627192:0:8527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612423.627196:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612423.627197:0:8527:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788612423.627200:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788612423.627202:0:8527:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788612423.627229:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8527:1875495932158336:0@lo:502: 00000100:00100000:0.0:1788612423.627299:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.627340:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.627375:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932158208:0@lo:8: 00000100:00100000:0.0:1788612423.627404:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.627794:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932158464:0@lo:400: 00000100:00100000:1.0:1788612423.627828:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.627850:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932158976:0@lo:400: 00000100:00100000:1.0:1788612423.627874:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.627895:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612423.627901:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932158848:0@lo:400: 00000100:00100000:1.0:1788612423.627924:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.627950:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932158592:0@lo:400: 00000100:00100000:1.0:1788612423.627982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.629323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158336 00000100:00100000:0.0:1788612423.629335:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158336 00000100:00100000:1.0:1788612423.630169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932159104:0@lo:400: 00000100:00100000:1.0:1788612423.630227:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.630268:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612423.630275:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932158720:0@lo:400: 00000100:00100000:1.0:1788612423.630298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.630340:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158464 00000100:00100000:1.0:1788612423.630345:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158464 00000100:00100000:1.0:1788612423.630372:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158976 00000100:00100000:1.0:1788612423.630376:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158976 00000100:00100000:1.0:1788612423.630399:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159104 00000100:00100000:1.0:1788612423.630402:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159104 00000100:00100000:1.0:1788612423.630425:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158720 00000100:00100000:2.0:1788612423.630551:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612423.630563:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932158464:12345-0@lo:400: 00000100:00100000:2.0:1788612423.630633:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932158464:12345-0@lo:400: Request processed in 71us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.630639:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612423.630658:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612423.630664:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932158976:12345-0@lo:400: 00000100:00100000:2.0:1788612423.630691:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932158976:12345-0@lo:400: Request processed in 28us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.630697:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612423.630709:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612423.630715:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932159104:12345-0@lo:400: 00000100:00100000:2.0:1788612423.630759:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932159104:12345-0@lo:400: Request processed in 44us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.630766:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788612423.630785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612423.630789:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612423.631117:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788612423.631127:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8527:x1875495932158336:12345-0@lo:502: 00000100:00100000:0.0:1788612423.631239:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:8527:x1875495932158336:12345-0@lo:502: Request processed in 114us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.631246:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788612423.631289:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158208 00000100:00100000:0.0:1788612423.631294:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158208 00000100:00100000:0.0:1788612423.631316:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612423.631321:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932158208:12345-0@lo:8: 00010000:00080000:0.0:1788612423.631344:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1788612423.631410:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7df2 00000100:00100000:1.0:1788612423.631564:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158720 00000100:00100000:1.0:1788612423.631595:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612423.631602:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932158720:12345-0@lo:400: 00000100:00100000:1.0:1788612423.631646:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932158720:12345-0@lo:400: Request processed in 45us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612423.631653:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612423.631677:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158848 00000100:00100000:1.0:1788612423.631680:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158848 00000100:00100000:1.0:1788612423.631696:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932158592 00000100:00100000:1.0:1788612423.631699:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932158592 00000100:00100000:1.0:1788612423.631712:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612423.631718:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932158848:12345-0@lo:400: 00000100:00100000:1.0:1788612423.631759:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932158848:12345-0@lo:400: Request processed in 41us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612423.631765:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612423.631777:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788612423.631790:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932158592:12345-0@lo:400: 00000100:00100000:1.0:1788612423.631820:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932158592:12345-0@lo:400: Request processed in 31us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612423.631826:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612423.632173:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932158848:0@lo:400: 00010000:00080000:2.0:1788612423.632190:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe977b80 x1875495932158464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612423.632201:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932158464:0@lo:400: 00010000:00080000:2.0:1788612423.632217:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe975180 x1875495932158976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612423.632226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932158976:0@lo:400: 00010000:00080000:2.0:1788612423.632262:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe977100 x1875495932158720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612423.632271:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932158720:0@lo:400: 00000100:00100000:2.0:1788612423.632281:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932158592:0@lo:400: 00010000:00080000:2.0:1788612423.632294:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe976680 x1875495932159104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612423.632302:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932159104:0@lo:400: 00002000:00100000:0.0:1788612423.632592:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff961300766800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788612423.632597:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788612423.632601:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788612423.632668:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788612423.632864:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788612423.632890:0:8439:0:(import.c:65:import_set_state_nolock()) ffff961300762000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612423.632944:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932158208:12345-0@lo:8: Request processed in 1622us (5540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.632951:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612423.634736:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8527:1875495932158336:0@lo:502: 00000020:01000000:0.0:1788612423.634775:0:8527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612423.634782:0:8527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612423.634785:0:8527:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788612423.634790:0:8527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:0.0:1788612423.634924:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fb850a80 x1875495932158208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612423.634935:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612423.634942:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788612423.634950:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788612423.634956:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788612423.634959:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c92f1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788612423.634975:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788612423.634982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932158208:0@lo:8: 00000004:00080000:3.0:1788612423.635598:0:8532:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788612423.635682:0:8532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 238019205460ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788612423.635691:0:8532:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:0.0:1788612423.643206:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788612423.643248:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788612423.643261:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.643285:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612423.643295:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612423.643298:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612c7237000 from 30 10000000:01000000:0.0:1788612423.643301:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612423.643335:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.643343:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.643354:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.643376:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932159232:0@lo:101: 00000100:00100000:0.0:1788612423.643435:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.643471:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fccdb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.643784:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159232 00000100:00100000:0.0:1788612423.643791:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159232 00000100:00100000:0.0:1788612423.643830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788612423.643838:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932159232:12345-0@lo:101: 00010000:00010000:0.0:1788612423.643851:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612423.643863:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7df9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.643886:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.643909:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.643917:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961302171600, rc 0) 00000100:00100000:0.0:1788612423.643955:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932159232:12345-0@lo:101: Request processed in 117us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.643961:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788612423.644001:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932159232:0@lo:101: 00010000:00010000:0.0:1788612423.644013:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.644022:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.644082:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932159360:0@lo:501: 00000100:00100000:0.0:1788612423.645078:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.645112:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fccdb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.645232:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159360 00000100:00100000:0.0:1788612423.645238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159360 00000100:00100000:0.0:1788612423.645276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788612423.645286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932159360:12345-0@lo:501: 00000100:00100000:0.0:1788612423.645429:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932159360:12345-0@lo:501: Request processed in 144us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.645436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788612423.645554:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932159360:0@lo:501: 00000100:00100000:0.0:1788612423.645602:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932159488:0@lo:503: 00000100:00100000:0.0:1788612423.645665:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.645695:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fccdb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.645709:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159488 00000100:00100000:0.0:1788612423.645713:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159488 00000100:00100000:0.0:1788612423.645738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788612423.645746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932159488:12345-0@lo:503: 00000100:00100000:0.0:1788612423.645836:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932159488:12345-0@lo:503: Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.645843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788612423.645915:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932159488:0@lo:503: 00000100:00100000:0.0:1788612423.646039:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932159616:0@lo:700: 00000100:00100000:0.0:1788612423.646070:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.646118:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159616 00000100:00100000:0.0:1788612423.646122:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159616 00000100:00100000:0.0:1788612423.646170:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612423.646178:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8534:x1875495932159616:12345-0@lo:700: 00000100:00100000:0.0:1788612423.646211:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1875495932159744:0@lo:700: 00000100:00100000:0.0:1788612423.646252:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.646273:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fccdb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.646348:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6cab40 going to sleep for 11 seconds 00000100:00080000:2.0:1788612423.646626:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612423.646642:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159744 00000100:00100000:2.0:1788612423.646646:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159744 00000100:00100000:2.0:1788612423.646683:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612423.646692:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1875495932159744:12345-0@lo:700: 00000100:00100000:0.0:1788612423.646703:0:8537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8537:1875495932159872:0@lo:502: 00000100:00100000:0.0:1788612423.646746:0:8537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.646768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932159872 00000100:00100000:0.0:1788612423.646772:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932159872 00000100:00100000:0.0:1788612423.646799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788612423.646807:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8537:x1875495932159872:12345-0@lo:502: 00000100:00100000:0.0:1788612423.646903:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8537:x1875495932159872:12345-0@lo:502: Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.646911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788612423.646962:0:8537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d8afeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.646979:0:8537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8537:1875495932159872:0@lo:502: 00000100:00100000:0.0:1788612423.647025:0:8537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8537:1875495932160000:0@lo:502: 00000100:00100000:0.0:1788612423.647058:0:8537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.647076:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160000 00000100:00100000:0.0:1788612423.647080:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160000 00000100:00100000:0.0:1788612423.647101:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612423.647107:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8537:x1875495932160000:12345-0@lo:502: 00000100:00100000:0.0:1788612423.647194:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:8537:x1875495932160000:12345-0@lo:502: Request processed in 86us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.647201:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:0.0:1788612423.647435:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788612423.647516:0:8537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d8afeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.647533:0:8537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8537:1875495932160000:0@lo:502: 00000040:00080000:0.0:1788612423.647557:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788612423.647629:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788612423.647656:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612423.647666:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.647678:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612423.647688:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612423.647696:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c7237000 from 5 10000000:01000000:0.0:1788612423.647699:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612423.647728:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.647736:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.647745:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.647759:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160128:0@lo:101: 00000100:00100000:0.0:1788612423.647792:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.647808:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d8afeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.647821:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160128 00000100:00100000:0.0:1788612423.647826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160128 00000100:00100000:0.0:1788612423.647852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612423.647861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932160128:12345-0@lo:101: 00010000:00010000:0.0:1788612423.647869:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612423.647880:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e07 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.647901:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.647911:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.647921:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961302170600, rc 0) 00000100:00100000:0.0:1788612423.647952:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932160128:12345-0@lo:101: Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.647964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612423.648003:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160128:0@lo:101: 00010000:00010000:0.0:1788612423.648016:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648025:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.648062:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160256:0@lo:256: 00000100:00100000:0.0:1788612423.648091:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.648103:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d8afeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.648116:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160256 00000100:00100000:0.0:1788612423.648120:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160256 00000100:00100000:0.0:1788612423.648142:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612423.648149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932160256:12345-0@lo:256: 20000000:01000000:0.0:1788612423.648161:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612423.648178:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612423.648182:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788612423.648259:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932160256:12345-0@lo:256: Request processed in 109us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.648266:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612423.648297:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160256:0@lo:256: 10000000:01000000:0.0:1788612423.648340:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612423.648349:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648357:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612423.648371:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788612423.648373:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788612423.648376:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788612423.648401:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648408:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648417:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.648429:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160384:0@lo:101: 00000100:00100000:0.0:1788612423.648455:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.648503:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.648519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160384 00000100:00100000:0.0:1788612423.648522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160384 00000100:00100000:0.0:1788612423.648552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788612423.648560:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932160384:12345-0@lo:101: 00010000:00010000:0.0:1788612423.648567:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612423.648576:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e15 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648591:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648600:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648631:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924400, rc 0) 00000100:00100000:0.0:1788612423.648668:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932160384:12345-0@lo:101: Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.648675:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788612423.648714:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160384:0@lo:101: 00010000:00010000:0.0:1788612423.648727:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.648735:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.648781:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160512:0@lo:501: 00000100:00100000:0.0:1788612423.648809:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.648829:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.648841:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160512 00000100:00100000:0.0:1788612423.648845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160512 00000100:00100000:0.0:1788612423.648872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788612423.648879:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932160512:12345-0@lo:501: 00000100:00100000:0.0:1788612423.648974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932160512:12345-0@lo:501: Request processed in 96us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.648982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788612423.649013:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160512:0@lo:501: 00000100:00100000:0.0:1788612423.649037:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160640:0@lo:503: 00000100:00100000:0.0:1788612423.649073:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.649087:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.649103:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160640 00000100:00100000:0.0:1788612423.649107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160640 00000100:00100000:0.0:1788612423.649127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788612423.649134:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932160640:12345-0@lo:503: 00000100:00100000:0.0:1788612423.649214:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932160640:12345-0@lo:503: Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.649222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788612423.649266:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932160640:0@lo:503: 00000100:00100000:0.0:1788612423.649593:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8538:1875495932160768:0@lo:502: 00000100:00100000:0.0:1788612423.649644:0:8538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.649669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160768 00000100:00100000:0.0:1788612423.649673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160768 00000100:00100000:0.0:1788612423.649703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788612423.649711:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:8538:x1875495932160768:12345-0@lo:502: 00000100:00100000:0.0:1788612423.649794:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:8538:x1875495932160768:12345-0@lo:502: Request processed in 83us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.649802:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788612423.649861:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d8afeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.649879:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8538:1875495932160768:0@lo:502: 00000020:01000000:0.0:1788612423.649906:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612423.649912:0:8538:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788612423.649919:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612423.649922:0:8538:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788612423.649928:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788612423.649932:0:8538:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1788612423.649953:0:8538:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788612423.649956:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612423.649976:0:8538:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9612fb85b380) 00000020:00000080:0.0:1788612423.649997:0:8538:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788612423.650004:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788612423.650073:0:8538:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788612423.650078:0:8538:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788612423.650086:0:8538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7e2a 00010000:00080000:0.0:1788612423.650113:0:8538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612c92f3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612423.650373:0:8538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:0.0:1788612423.654528:0:8538:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 40000000:02000000:2.0:1788612423.654541:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:0.0:1788612423.654552:0:8538:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788612423.654760:0:8538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612423.655113:0:8538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612423.655235:0:8538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788612423.655352:0:8538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788612423.656184:0:8539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612423.656190:0:8539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788612423.657816:0:8538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612423.657829:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788612423.657870:0:8538:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788612423.657895:0:8538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7e31 00000100:00080000:3.0:1788612423.657906:0:8538:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612423.657918:0:8538:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9612c92f3800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612423.657953:0:8538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc7100 x1875495932160896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612423.657977:0:8538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788612423.661558:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612423.661567:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612423.661569:0:8538:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788612423.661573:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612423.661576:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612423.661577:0:8538:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788612423.661580:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788612423.661581:0:8538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788612423.661633:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8538:1875495932161024:0@lo:502: 00000100:00100000:3.0:1788612423.661707:0:8538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612423.661745:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.661912:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161024 00000100:00100000:0.0:1788612423.661919:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161024 00000100:00100000:0.0:1788612423.661961:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788612423.661970:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:8538:x1875495932161024:12345-0@lo:502: 00000100:00100000:0.0:1788612423.662109:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:8538:x1875495932161024:12345-0@lo:502: Request processed in 140us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.662117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788612423.662267:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932160896:0@lo:8: 00000100:00100000:1.0:1788612423.662304:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.663148:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932160896 00000100:00100000:0.0:1788612423.663154:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932160896 00000100:00100000:0.0:1788612423.663178:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612423.663184:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932160896:12345-0@lo:8: 00010000:00080000:0.0:1788612423.663207:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1788612423.663233:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7e38 00002000:00100000:0.0:1788612423.663247:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9612fe9f3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788612423.663256:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788612423.663258:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788612423.663319:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788612423.663342:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9612fe9f4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612423.663392:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932160896:12345-0@lo:8: Request processed in 207us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.663399:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612423.663578:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:8538:1875495932161024:0@lo:502: 00000020:01000000:3.0:1788612423.663621:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612423.663627:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612423.663629:0:8538:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788612423.663633:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788612423.663710:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788612423.663740:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788612423.663751:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.663762:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612423.663777:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788612423.663780:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9612d1e64d40 from 1 10000000:01000000:0.0:1788612423.663783:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788612423.663810:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.663818:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.663828:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.663844:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932161152:0@lo:101: 00000100:00100000:0.0:1788612423.663895:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.663924:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.663939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161152 00000100:00100000:0.0:1788612423.663943:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161152 00000100:00100000:0.0:1788612423.663972:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612423.663980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932161152:12345-0@lo:101: 00010000:00010000:0.0:1788612423.663989:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612423.664012:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e3f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.664034:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.664045:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.664054:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924e00, rc 0) 00000100:00100000:0.0:1788612423.664086:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932161152:12345-0@lo:101: Request processed in 106us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.664092:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612423.664125:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932161152:0@lo:101: 00010000:00010000:0.0:1788612423.664137:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.664146:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612423.664194:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932161280:0@lo:501: 00000100:00100000:0.0:1788612423.664218:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.664232:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.664252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161280 00000100:00100000:0.0:1788612423.664255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161280 00000100:00100000:0.0:1788612423.664278:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788612423.664285:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932161280:12345-0@lo:501: 00000100:00100000:0.0:1788612423.664350:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932161280:12345-0@lo:501: Request processed in 65us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612423.664357:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788612423.664397:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932161280:0@lo:501: 10000000:01000000:0.0:1788612423.664418:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788612423.664424:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612423.664432:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612423.666462:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1875495932159744:12345-0@lo:700: Request processed in 19765us (20204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.666496:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788612423.666548:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fb851500 x1875495932159744/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612423.666562:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1875495932159744:0@lo:700: 40000000:02000000:2.0:1788612423.666575:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00010000:00080000:0.0:1788612423.668616:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc7100 x1875495932160896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612423.668630:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612423.668641:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788612423.668649:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788612423.668654:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788612423.668658:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c92f3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788612423.668674:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788612423.668680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932160896:0@lo:8: 00000004:00080000:0.0:1788612423.668712:0:8539:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788612423.668784:0:8539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 238052307409ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788612423.668791:0:8539:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788612423.671282:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932161408:0@lo:41: 00000100:00100000:1.0:1788612423.671380:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.671547:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161408 00000100:00100000:0.0:1788612423.671556:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161408 00000100:00100000:0.0:1788612423.671657:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612423.671667:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932161408:12345-0@lo:41: 00000004:00000024:0.0:1788612423.671702:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788612423.671754:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932161408:12345-0@lo:41: Request processed in 88us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.671761:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612423.672055:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932161408:0@lo:41: 00000004:00080000:2.0:1788612423.677181:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788612423.677275:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612423.677295:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932161536:0@lo:13: 00000100:00100000:2.0:1788612423.677371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788612423.677430:0:8540:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788612423.677455:0:8540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932161664:0@lo:7: 00000100:00100000:2.0:1788612423.677505:0:8540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612423.677534:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161664 00000100:00100000:2.0:1788612423.677540:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161664 00000100:00100000:2.0:1788612423.677592:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612423.677601:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8540:x1875495932161664:12345-0@lo:7: 00000100:00100000:3.0:1788612423.680574:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161536 00000100:00100000:3.0:1788612423.680586:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161536 00000100:00100000:3.0:1788612423.680658:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612423.680669:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932161536:12345-0@lo:13: 00002000:00000024:3.0:1788612423.680695:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:3.0:1788612423.680774:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932161536:12345-0@lo:13: Request processed in 107us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612423.680781:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612423.680843:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed3800 x1875495932161536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.680869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932161536:0@lo:13: 00000100:00100000:0.0:1788612423.681202:0:8540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d240 going to sleep for 11 seconds 00000100:00080000:2.0:1788612423.681928:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788612423.687126:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788612423.687135:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788612423.690243:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8534:x1875495932159616:12345-0@lo:700: Request processed in 44059us (44164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.690257:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612423.690385:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fb850a80 x1875495932159616/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.690408:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932159616:0@lo:700: 00002000:00080000:2.0:1788612423.690927:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788612423.690933:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788612423.690988:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8540:x1875495932161664:12345-0@lo:7: Request processed in 13386us (13480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612423.690997:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788612423.691035:0:8540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed3100 x1875495932161664/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612423.691047:0:8540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932161664:0@lo:7: 00000004:00080000:0.0:1788612423.691056:0:8540:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788612423.691086:0:8540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932161792:0@lo:5: 00000100:00100000:0.0:1788612423.691117:0:8540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.691158:0:8540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612423.691161:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161792 00000100:00100000:2.0:1788612423.691173:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161792 00000100:00100000:2.0:1788612423.691214:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612423.691223:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8540:x1875495932161792:12345-0@lo:5: 00002000:00080000:2.0:1788612423.691245:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788612423.691249:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788612423.691526:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8540:x1875495932161792:12345-0@lo:5: Request processed in 304us (407us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788612423.691532:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788612423.691811:0:8540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fb852300 x1875495932161792/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.691823:0:8540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932161792:0@lo:5: 00000004:00080000:3.0:1788612423.691831:0:8540:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788612423.691854:0:8540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932161920:0@lo:700: 00000100:00100000:3.0:1788612423.691881:0:8540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612423.691935:0:8540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.691969:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932161920 00000100:00100000:0.0:1788612423.691973:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932161920 00000100:00100000:2.0:1788612423.692028:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612423.692036:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8540:x1875495932161920:12345-0@lo:700: 00000001:00080000:0.0:1788612423.696832:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788612423.697598:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8540:x1875495932161920:12345-0@lo:700: Request processed in 5558us (5710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612423.697625:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612423.697775:0:8540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc4a80 x1875495932161920/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612423.697787:0:8540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788612423.697801:0:8540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932161920:0@lo:700: 00000004:02000040:0.0:1788612423.699277:0:8540:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000004:00080000:1.0:1788612423.702192:0:8534:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788612423.702225:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932162176:0@lo:7: 00000100:00100000:1.0:1788612423.702301:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.702347:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612423.702364:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612423.702375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932162048:0@lo:13: 00000100:00100000:1.0:1788612423.702400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612423.702454:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162048 00000100:00100000:1.0:1788612423.702461:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162048 00000100:00100000:1.0:1788612423.702531:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612423.702540:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932162048:12345-0@lo:13: 00002000:00000024:1.0:1788612423.702559:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923836928 avail 3692314624 00000100:00100000:1.0:1788612423.702616:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932162048:12345-0@lo:13: Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612423.702623:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788612423.702663:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed5ad80 x1875495932162048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612423.702695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932162048:0@lo:13: 00000100:00100000:1.0:1788612423.702721:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162176 00000100:00100000:1.0:1788612423.702724:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162176 00000100:00100000:1.0:1788612423.702751:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612423.702758:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8534:x1875495932162176:12345-0@lo:7: 00000100:00100000:0.0:1788612423.710336:0:8540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932162304:0@lo:5: 00000100:00100000:0.0:1788612423.710404:0:8540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612423.710829:0:8540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612423.711582:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00002000:00080000:1.0:1788612423.714983:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788612423.714992:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788612423.715095:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8534:x1875495932162176:12345-0@lo:7: Request processed in 12332us (12790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612423.715109:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612423.715139:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162304 00000100:00100000:1.0:1788612423.715145:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162304 00000100:00100000:1.0:1788612423.715189:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612423.715196:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8540:x1875495932162304:12345-0@lo:5: 00010000:00080000:3.0:1788612423.715566:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed58700 x1875495932162176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.715582:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932162176:0@lo:7: 00000004:00080000:3.0:1788612423.715594:0:8534:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788612423.715646:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932162432:0@lo:5: 00000100:00100000:3.0:1788612423.715685:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612423.715723:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612423.718536:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788612423.718794:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788612423.718804:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162432 00000100:00100000:1.0:1788612423.718813:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162432 00000100:00100000:0.0:1788612423.719659:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612423.719672:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8534:x1875495932162432:12345-0@lo:5: 00002000:00080000:0.0:1788612423.719707:0:8543:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788612423.719788:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8534:x1875495932162432:12345-0@lo:5: Request processed in 119us (4102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612423.719795:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788612423.720251:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6a00 x1875495932162432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.720266:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932162432:0@lo:5: 00000004:00080000:3.0:1788612423.720279:0:8534:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788612423.720324:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932162560:0@lo:5: 00000100:00100000:3.0:1788612423.720359:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612423.720398:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612423.720682:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162560 00000100:00100000:1.0:1788612423.720689:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162560 00000100:00100000:1.0:1788612423.720728:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612423.720736:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8534:x1875495932162560:12345-0@lo:5: 00002000:00080000:1.0:1788612423.720764:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788612423.722403:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8534:x1875495932162560:12345-0@lo:5: Request processed in 1662us (2038us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788612423.722415:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788612423.722562:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6a00 x1875495932162560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.722578:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8534:1875495932162560:0@lo:5: 00000004:00080000:3.0:1788612423.722592:0:8534:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788612423.722639:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8534:1875495932162688:0@lo:900: 00000100:00100000:3.0:1788612423.722668:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612423.722692:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612423.722717:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162688 00000100:00100000:3.0:1788612423.722721:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162688 00000100:00100000:3.0:1788612423.722756:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612423.722763:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8534:x1875495932162688:12345-0@lo:900: 00000100:00100000:3.0:1788612423.722800:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8534:x1875495932162688:12345-0@lo:900: Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612423.722807:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788612423.722833:0:8534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6680 x1875495932162688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612423.722842:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8534:1875495932162688:0@lo:900: 00002000:00080000:1.0:1788612423.724439:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788612423.724455:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788612423.726461:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8540:x1875495932162304:12345-0@lo:5: Request processed in 11258us (16050us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788612423.726472:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788612423.726753:0:8540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fb852300 x1875495932162304/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612423.726773:0:8540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8540:1875495932162304:0@lo:5: 00000004:00080000:0.0:1788612423.726787:0:8540:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788612424.047728:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612425.073011:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612426.111331:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612426.735613:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612426.735638:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932162816:0@lo:41: 00000100:00100000:0.0:1788612426.735722:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612426.735859:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162816 00000100:00100000:3.0:1788612426.735869:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162816 00000100:00100000:3.0:1788612426.735923:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612426.735934:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932162816:12345-0@lo:41: 00000004:00000024:3.0:1788612426.736087:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788612426.736148:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932162816:12345-0@lo:41: Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612426.736154:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612426.736237:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932162816:0@lo:41: 00010000:00010000:3.0:1788612427.122084:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612428.146053:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612428.448082:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788612428.783718:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932162944:0@lo:41: 00000100:00100000:1.0:1788612428.783786:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.783867:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932162944 00000100:00100000:1.0:1788612428.783874:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932162944 00000100:00100000:1.0:1788612428.783916:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612428.783924:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932162944:12345-0@lo:41: 00000004:00000024:1.0:1788612428.783953:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788612428.783995:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932162944:12345-0@lo:41: Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612428.784001:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612428.784047:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932162944:0@lo:41: 00000100:00100000:1.0:1788612428.785011:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932163072:0@lo:400: 00000100:00100000:1.0:1788612428.785063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.785093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932163584:0@lo:400: 00000100:00100000:1.0:1788612428.785118:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.785137:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932164096:0@lo:13: 00000100:00100000:1.0:1788612428.785159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.785180:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788612428.785186:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932163200:0@lo:400: 00000100:00100000:1.0:1788612428.785207:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.785229:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932163712:0@lo:400: 00000100:00100000:1.0:1788612428.785250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.785301:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163584 00000100:00100000:1.0:1788612428.785307:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163584 00000100:00100000:1.0:1788612428.785359:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163200 00000100:00100000:1.0:1788612428.785362:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163200 00000100:00100000:1.0:1788612428.785431:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163712 00000100:00100000:1.0:1788612428.785434:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163712 00000100:00100000:1.0:1788612428.785453:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612428.785538:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612428.785542:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932163584:12345-0@lo:400: 00000100:00100000:0.0:1788612428.785551:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932163200:12345-0@lo:400: 00000100:00100000:1.0:1788612428.785604:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932163584:12345-0@lo:400: Request processed in 142us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612428.785612:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612428.785616:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932163200:12345-0@lo:400: Request processed in 67us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612428.785632:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788612428.785639:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612428.785644:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932163712:12345-0@lo:400: 00000100:00100000:1.0:1788612428.785678:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932163712:12345-0@lo:400: Request processed in 39us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612428.785678:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164096 00000100:00100000:0.0:1788612428.785685:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164096 00000100:00100000:1.0:1788612428.785689:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788612428.785710:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612428.785715:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612428.785717:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612428.785727:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612428.785733:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932164224:0@lo:13: 00000100:00100000:0.0:1788612428.785738:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932164096:12345-0@lo:13: 00002000:00000024:0.0:1788612428.785763:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612428.785768:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612428.785808:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932164096:12345-0@lo:13: Request processed in 73us (647us total) trans 0 rc 0/0 00010000:00080000:1.0:1788612428.785811:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed1f80 x1875495932163200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612428.785818:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612428.785830:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932163200:0@lo:400: 00000100:00100000:0.0:1788612428.785834:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164224 00000100:00100000:0.0:1788612428.785839:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164224 00010000:00080000:1.0:1788612428.785844:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed3100 x1875495932163712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612428.785854:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932163712:0@lo:400: 00000100:00100000:0.0:1788612428.785864:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612428.785875:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875495932164224:12345-0@lo:13: 00010000:00080000:1.0:1788612428.785884:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed3480 x1875495932163584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788612428.785886:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612428.785898:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932163584:0@lo:400: 00010000:00080000:1.0:1788612428.785912:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe974380 x1875495932164096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612428.785924:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875495932164224:12345-0@lo:13: Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612428.785928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932164096:0@lo:13: 00000100:00100000:0.0:1788612428.785935:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612428.785959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932163328:0@lo:400: 00000100:00080000:1.0:1788612428.785962:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788612428.785984:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6680 x1875495932164224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612428.785995:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612428.786002:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932164224:0@lo:13: 00000100:00100000:0.0:1788612428.786029:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932163840:0@lo:400: 00000100:00100000:0.0:1788612428.786051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612428.786077:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788612428.786084:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932163456:0@lo:400: 00000100:00100000:0.0:1788612428.786109:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612428.786131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932163968:0@lo:400: 00000100:00100000:0.0:1788612428.786153:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612428.786191:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163456 00000100:00100000:0.0:1788612428.786195:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163456 00000100:00100000:0.0:1788612428.786222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788612428.786229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932163456:12345-0@lo:400: 00000100:00100000:2.0:1788612428.786236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163072 00000100:00100000:2.0:1788612428.786242:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163072 00000100:00100000:0.0:1788612428.786264:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932163456:12345-0@lo:400: Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612428.786271:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612428.786279:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788612428.786288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3648:x1875495932163072:12345-0@lo:400: 00010000:00080000:0.0:1788612428.786308:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed1180 x1875495932163456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612428.786319:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932163456:0@lo:400: 00000100:00100000:2.0:1788612428.786334:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3648:x1875495932163072:12345-0@lo:400: Request processed in 46us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612428.786342:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788612428.786832:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163328 00000100:00100000:3.0:1788612428.786839:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163328 00000100:00100000:3.0:1788612428.786888:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788612428.786897:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932163328:12345-0@lo:400: 00000100:00100000:3.0:1788612428.786953:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932163328:12345-0@lo:400: Request processed in 58us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612428.786959:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612428.787089:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932163328:0@lo:400: 00000100:00100000:1.0:1788612428.787196:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163840 00000100:00100000:1.0:1788612428.787200:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163840 00000100:00100000:1.0:1788612428.787425:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932163968 00000100:00100000:1.0:1788612428.787430:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932163968 00000100:00100000:0.0:1788612428.790016:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612428.790037:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932163840:12345-0@lo:400: 00000100:00100000:0.0:1788612428.790122:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932163840:12345-0@lo:400: Request processed in 93us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612428.790130:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612428.790152:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612428.790159:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932163968:12345-0@lo:400: 00000100:00100000:0.0:1788612428.790188:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932163968:12345-0@lo:400: Request processed in 30us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612428.790194:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612428.790248:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932163072:0@lo:400: 00010000:00080000:2.0:1788612428.796685:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe976680 x1875495932163968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612428.796704:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932163968:0@lo:400: 00010000:00080000:2.0:1788612428.796724:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed3800 x1875495932163840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612428.796733:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932163840:0@lo:400: 00010000:00010000:3.0:1788612429.168700:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788612429.246048:0:8867:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612429.246256:0:8867:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1788612429.813393:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788612429.813419:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788612430.191746:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612431.226268:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612431.858445:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612431.858473:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932164352:0@lo:41: 00000100:00100000:0.0:1788612431.858573:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612431.858751:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164352 00000100:00100000:2.0:1788612431.858758:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164352 00000100:00100000:2.0:1788612431.858814:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612431.858825:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932164352:12345-0@lo:41: 00000004:00000024:2.0:1788612431.858862:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788612431.858914:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932164352:12345-0@lo:41: Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612431.858920:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612431.859102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932164352:0@lo:41: 00000020:00000004:1.0:1788612431.869220:0:8968:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612431.869781:0:8968:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788612432.240056:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612432.695931:0:9016:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612432.695941:0:9016:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788612433.263646:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612433.904655:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932164480:0@lo:13: 00000100:00100000:1.0:1788612433.904699:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612433.904724:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612433.904760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932164608:0@lo:13: 00000100:00100000:1.0:1788612433.904794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612433.905016:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164480 00000100:00100000:3.0:1788612433.905023:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164480 00000100:00100000:3.0:1788612433.905067:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164608 00000100:00100000:3.0:1788612433.905070:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164608 00000100:00100000:3.0:1788612433.905086:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612433.905095:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932164480:12345-0@lo:13: 00002000:00000024:3.0:1788612433.905144:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612433.905188:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932164480:12345-0@lo:13: Request processed in 94us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612433.905194:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612433.905209:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612433.905215:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932164608:12345-0@lo:13: 00002000:00000024:3.0:1788612433.905225:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612433.905250:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932164608:12345-0@lo:13: Request processed in 35us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612433.905256:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788612433.905271:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788612433.905297:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6680 x1875495932164480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612433.905306:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788612433.905325:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932164480:0@lo:13: 00000100:00100000:0.0:1788612433.905393:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612433.905403:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932164736:0@lo:41: 00000100:00100000:0.0:1788612433.905450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612433.906515:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed5b800 x1875495932164608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612433.906528:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788612433.906559:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932164608:0@lo:13: 00000100:00100000:3.0:1788612433.906892:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164736 00000100:00100000:3.0:1788612433.906899:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164736 00000100:00100000:3.0:1788612433.907028:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612433.907037:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932164736:12345-0@lo:41: 00000004:00000024:3.0:1788612433.907064:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788612433.907139:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932164736:12345-0@lo:41: Request processed in 102us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612433.907146:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612433.907830:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932165120:0@lo:400: 00000100:00100000:1.0:1788612433.907874:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612433.907937:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932164736:0@lo:41: 00000100:00100000:1.0:1788612433.907956:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612433.907962:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932165248:0@lo:400: 00000100:00100000:1.0:1788612433.908021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612433.908106:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932164864:0@lo:400: 00000100:00100000:3.0:1788612433.908144:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612433.908174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932165376:0@lo:400: 00000100:00100000:3.0:1788612433.908216:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932164992:0@lo:400: 00000100:00100000:0.0:1788612433.914658:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165120 00000100:00100000:0.0:1788612433.914674:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165120 00000100:00100000:0.0:1788612433.916686:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788612433.916705:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932165120:12345-0@lo:400: 00000100:00100000:0.0:1788612433.916791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932165120:12345-0@lo:400: Request processed in 94us (8917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612433.916798:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612433.918339:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932165120:0@lo:400: 00000100:00100000:1.0:1788612433.918381:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165248 00000100:00100000:1.0:1788612433.918388:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165248 00000100:00100000:1.0:1788612433.918434:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612433.918444:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932165248:12345-0@lo:400: 00000100:00100000:1.0:1788612433.918555:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932165248:12345-0@lo:400: Request processed in 112us (10534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612433.918564:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612433.918592:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612433.918642:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed70000 x1875495932165248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612433.918654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932165248:0@lo:400: 00000100:00100000:2.0:1788612433.918816:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612433.918842:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932165504:0@lo:400: 00000100:00100000:2.0:1788612433.918872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612433.918899:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165376 00000100:00100000:2.0:1788612433.918903:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165376 00000100:00100000:2.0:1788612433.918932:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164992 00000100:00100000:2.0:1788612433.918934:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164992 00000100:00100000:2.0:1788612433.918947:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165504 00000100:00100000:2.0:1788612433.918949:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165504 00000100:00100000:2.0:1788612433.918963:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612433.918969:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932165376:12345-0@lo:400: 00000100:00100000:2.0:1788612433.919004:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932165376:12345-0@lo:400: Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612433.919010:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612433.919023:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612433.919029:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932164992:12345-0@lo:400: 00000100:00100000:2.0:1788612433.919071:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932164992:12345-0@lo:400: Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612433.919077:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612433.919089:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612433.919094:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932165504:12345-0@lo:400: 00000100:00100000:2.0:1788612433.919121:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932165504:12345-0@lo:400: Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612433.919126:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788612433.919140:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612433.919144:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612433.919164:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed72a00 x1875495932165376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612433.919174:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932165376:0@lo:400: 00010000:00080000:2.0:1788612433.919197:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6a00 x1875495932164992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612433.919205:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932164992:0@lo:400: 00010000:00080000:2.0:1788612433.919214:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71880 x1875495932165504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612433.919221:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932165504:0@lo:400: 00000100:00100000:2.0:1788612433.919578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932164864 00000100:00100000:2.0:1788612433.919583:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932164864 00000100:00100000:2.0:1788612433.919626:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788612433.919634:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3650:x1875495932164864:12345-0@lo:400: 00000100:00100000:2.0:1788612433.919675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3650:x1875495932164864:12345-0@lo:400: Request processed in 42us (11531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612433.919692:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788612433.919728:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932164864:0@lo:400: 00010000:00010000:0.0:1788612434.290669:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612435.311674:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612436.340666:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612436.977791:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612436.977819:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932165632:0@lo:41: 00000100:00100000:2.0:1788612436.977883:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612436.978019:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165632 00000100:00100000:3.0:1788612436.978027:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165632 00000100:00100000:3.0:1788612436.978081:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612436.978091:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932165632:12345-0@lo:41: 00000004:00000024:3.0:1788612436.978120:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788612436.978217:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932165632:12345-0@lo:41: Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612436.978224:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788612436.978322:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932165632:0@lo:41: 00010000:00010000:1.0:1788612437.359585:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612438.386040:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612439.023709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932165760:0@lo:13: 00000100:00100000:2.0:1788612439.023754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932165888:0@lo:41: 00000100:00100000:2.0:1788612439.023795:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.023866:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612439.023872:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932166016:0@lo:13: 00000100:00100000:1.0:1788612439.023947:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165888 00000100:00100000:1.0:1788612439.023955:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165888 00000100:00100000:1.0:1788612439.024006:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612439.024016:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932165888:12345-0@lo:41: 00000004:00000024:1.0:1788612439.024047:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788612439.024094:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612439.024114:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932165888:12345-0@lo:41: Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612439.024134:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612439.024147:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932165760 00000100:00100000:3.0:1788612439.024152:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932165760 00000100:00100000:3.0:1788612439.024210:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612439.024214:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612439.024232:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932165760:12345-0@lo:13: 00002000:00000024:3.0:1788612439.024253:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612439.024253:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932165888:0@lo:41: 00000100:00100000:3.0:1788612439.024293:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932165760:12345-0@lo:13: Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612439.024299:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612439.024314:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166016 00000100:00100000:3.0:1788612439.024317:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166016 00010000:00080000:2.0:1788612439.024328:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71500 x1875495932165760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612439.024336:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612439.024346:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932166016:12345-0@lo:13: 00000100:00100000:2.0:1788612439.024350:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932165760:0@lo:13: 00002000:00000024:3.0:1788612439.024357:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612439.024391:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932166016:12345-0@lo:13: Request processed in 46us (180us total) trans 0 rc 0/0 00010000:00080000:2.0:1788612439.024407:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fe975180 x1875495932166016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612439.024424:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932166016:0@lo:13: 00000100:00100000:3.0:1788612439.024426:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788612439.024632:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612439.024797:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932166528:0@lo:400: 00000100:00100000:2.0:1788612439.024827:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.024852:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612439.024858:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932166400:0@lo:400: 00000100:00100000:2.0:1788612439.024890:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.024913:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166400 00000100:00100000:2.0:1788612439.024917:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166400 00000100:00100000:2.0:1788612439.024941:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788612439.024947:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932166400:12345-0@lo:400: 00000100:00100000:2.0:1788612439.024977:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932166400:12345-0@lo:400: Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612439.024983:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788612439.025007:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932166400:0@lo:400: 00000100:00100000:2.0:1788612439.025022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932166272:0@lo:400: 00000100:00100000:2.0:1788612439.025064:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.025081:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932166784:0@lo:400: 00000100:00100000:2.0:1788612439.025114:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.025191:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788612439.025197:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932166144:0@lo:400: 00000100:00100000:2.0:1788612439.025224:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.025245:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932166656:0@lo:400: 00000100:00100000:2.0:1788612439.025263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612439.025286:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166528 00000100:00100000:2.0:1788612439.025289:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166528 00000100:00100000:0.0:1788612439.025435:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166272 00000100:00100000:0.0:1788612439.025440:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166272 00000100:00100000:0.0:1788612439.025464:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166784 00000100:00100000:0.0:1788612439.025466:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166784 00000100:00100000:0.0:1788612439.025608:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166656 00000100:00100000:0.0:1788612439.025613:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166656 00000100:00100000:0.0:1788612439.025629:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612439.025636:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932166272:12345-0@lo:400: 00000100:00100000:0.0:1788612439.025681:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932166272:12345-0@lo:400: Request processed in 46us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612439.025689:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612439.025709:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612439.025716:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932166784:12345-0@lo:400: 00010000:00080000:3.0:1788612439.025720:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c692e680 x1875495932166272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612439.025734:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932166272:0@lo:400: 00000100:00100000:0.0:1788612439.025750:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932166784:12345-0@lo:400: Request processed in 35us (635us total) trans 0 rc 0/0 00010000:00080000:3.0:1788612439.025756:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c692c000 x1875495932166784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612439.025761:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788612439.025769:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932166784:0@lo:400: 00000100:00100000:0.0:1788612439.025788:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612439.025796:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932166656:12345-0@lo:400: 00000100:00100000:0.0:1788612439.025825:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932166656:12345-0@lo:400: Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612439.025830:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788612439.025887:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612439.025891:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612439.025959:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612439.025967:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932166528:12345-0@lo:400: 00010000:00080000:3.0:1788612439.025995:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c692ca80 x1875495932166656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612439.026005:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932166656:0@lo:400: 00000100:00100000:2.0:1788612439.026056:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932166528:12345-0@lo:400: Request processed in 90us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612439.026062:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612439.026084:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166144 00000100:00100000:2.0:1788612439.026094:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166144 00000100:00100000:2.0:1788612439.026131:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788612439.026138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3649:x1875495932166144:12345-0@lo:400: 00000100:00100000:2.0:1788612439.026171:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3649:x1875495932166144:12345-0@lo:400: Request processed in 34us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612439.026176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788612439.026900:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932166144:0@lo:400: 00010000:00080000:1.0:1788612439.035005:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c692ce00 x1875495932166528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612439.035026:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932166528:0@lo:400: 00010000:00010000:1.0:1788612439.408715:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612440.431758:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788612440.751221:0:9516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788612440.751225:0:9516:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788612440.751227:0:9516:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788612440.751369:0:9516:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9611c67e2000 00000020:01000004:0.0:1788612440.751385:0:9516:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788612440.751400:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788612440.751421:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9611c69d3380) 00000020:00000080:0.0:1788612440.751441:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788612440.815437:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788612440.815648:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788612440.832805:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788612440.833000:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788612440.833014:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788612440.833024:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1f8616bf0bc7e54 00000020:01000004:3.0:1788612440.833030:0:9516:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788612440.833052:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788612440.833055:0:9516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788612440.833060:0:9516:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788612440.833083:0:9516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788612440.833087:0:9516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788612440.863012:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788612440.863049:0:9516:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788612440.863057:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788612440.863058:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612440.863060:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612440.863061:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612440.863061:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612440.863062:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612440.863064:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612440.863065:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788612440.863066:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788612440.863068:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612440.863068:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612440.863072:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788612440.863074:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612440.863075:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612440.863076:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612440.863077:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612440.863078:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612440.863079:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612440.863080:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612440.863080:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788612440.863081:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788612440.863082:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612440.863083:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612440.863118:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788612440.863136:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932166912:0@lo:253: 00000100:00100000:3.0:1788612440.863204:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.863252:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.863339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932166912 00000100:00100000:2.0:1788612440.863346:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932166912 00000100:00100000:2.0:1788612440.863401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788612440.863411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:9516:x1875495932166912:12345-0@lo:253: 20000000:01000000:2.0:1788612440.863448:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788612440.863453:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788612440.863458:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788612440.863460:0:6517:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788612440.863701:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612440.863820:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788612440.863833:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788612440.863852:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788612440.863858:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788612440.863872:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788612440.863887:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788612440.863966:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788612440.863980:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:2.0:1788612440.863982:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788612440.863997:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788612440.864004:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788612440.864018:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788612440.864023:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1788612440.864036:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788612440.864042:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788612440.864067:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788612440.864086:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788612440.864156:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788612440.864167:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:2.0:1788612440.864169:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788612440.864182:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788612440.864187:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788612440.864198:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788612440.864202:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1788612440.864213:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788612440.864217:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788612440.864227:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788612440.864241:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788612440.864613:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788612440.864625:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:2.0:1788612440.864627:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788612440.864641:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788612440.864646:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788612440.864660:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788612440.864665:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1788612440.864679:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788612440.864684:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788612440.864697:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788612440.864715:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788612440.864728:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788612440.864731:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788612440.864734:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788612440.864774:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788612440.864777:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788612440.865925:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788612440.865959:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788612440.865973:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788612440.866196:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788612440.866218:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788612440.866243:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788612440.866253:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788612440.866256:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788612440.866919:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788612440.867089:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788612440.867111:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788612440.867125:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788612440.867136:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788612440.867137:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788612440.867785:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788612440.867810:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788612440.867827:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788612440.867998:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788612440.868019:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788612440.868049:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788612440.868059:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788612440.868061:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612440.868405:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788612440.868425:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788612440.868440:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788612440.868820:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788612440.868840:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788612440.868854:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788612440.868865:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788612440.868866:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612440.869096:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788612440.869122:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788612440.869132:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788612440.869273:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788612440.869293:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788612440.869390:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:3.0:1788612440.869407:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788612440.869426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869446:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869454:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869461:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869467:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869694:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869704:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869723:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869731:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869766:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869781:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 21 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.869795:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167040:0@lo:104: 00000100:00100000:3.0:1788612440.869854:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612440.869939:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.869948:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.869955:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167168:0@lo:104: 00000100:00100000:3.0:1788612440.869976:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612440.870048:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.870056:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 21 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.870064:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167296:0@lo:104: 00000100:00100000:3.0:1788612440.870092:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.870142:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167040 00000100:00100000:2.0:1788612440.870149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167040 00000100:00100000:2.0:1788612440.870181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167168 00000100:00100000:2.0:1788612440.870184:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167168 00000100:00100000:2.0:1788612440.870197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612440.870204:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6517:x1875495932167040:12345-0@lo:104: 00010000:00010000:2.0:1788612440.870217:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.870273:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612440.870279:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6517:x1875495932167040:12345-0@lo:104: Request processed in 75us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.870285:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788612440.870384:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612440.870391:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870398:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612440.870401:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870409:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612440.870414:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612440.870420:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612440.870454:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870460:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612440.870505:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870513:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7e3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e46 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870526:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612440.870527:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612440.870529:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612440.870577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612440.870585:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6517:x1875495932167168:12345-0@lo:104: 00010000:00010000:2.0:1788612440.870593:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.870631:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612440.870637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6517:x1875495932167168:12345-0@lo:104: Request processed in 54us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.870642:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788612440.870682:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612440.870687:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870692:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe924200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612440.870695:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870702:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612440.870708:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612440.870714:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612440.870730:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870735:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612440.870747:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870753:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.870762:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612440.870763:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612440.870765:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612440.870878:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.870887:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 21 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.870897:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167680:0@lo:104: 00000100:00100000:3.0:1788612440.870919:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612440.870934:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.870941:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 21 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.870949:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167808:0@lo:104: 00000100:00100000:3.0:1788612440.870967:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612440.870983:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.870991:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.870999:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167936:0@lo:104: 00000100:00100000:3.0:1788612440.871037:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612440.871056:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.871065:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.871085:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932168064:0@lo:104: 00000100:00100000:3.0:1788612440.871108:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.871127:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167040:0@lo:104: 00000100:00100000:3.0:1788612440.871136:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167168:0@lo:104: 00000100:00100000:2.0:1788612440.871192:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788612440.871210:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.871220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167296 00000100:00100000:2.0:1788612440.871225:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167296 00000100:00100000:2.0:1788612440.871243:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167680 00000100:00100000:2.0:1788612440.871254:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167680 00000100:00100000:2.0:1788612440.871268:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167808 00000100:00100000:2.0:1788612440.871270:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167808 00000100:00100000:2.0:1788612440.871279:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167936 00000100:00100000:2.0:1788612440.871281:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167936 00000100:00100000:2.0:1788612440.871288:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168064 00000100:00100000:2.0:1788612440.871290:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168064 00000100:00100000:2.0:1788612440.871378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612440.871386:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:6517:x1875495932167296:12345-0@lo:104: 00010000:00010000:2.0:1788612440.871394:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.871506:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612440.871513:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:6517:x1875495932167296:12345-0@lo:104: Request processed in 128us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.871518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612440.871531:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612440.871537:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:6517:x1875495932167680:12345-0@lo:104: 00010000:00010000:2.0:1788612440.871544:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.871637:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167296:0@lo:104: 00000100:00100000:3.0:1788612440.871645:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167680:0@lo:104: 00000100:00100000:1.0:1788612440.871722:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932167424:0@lo:103: 00000100:00100000:1.0:1788612440.871758:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.871825:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612440.871832:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932167552:0@lo:103: 00000100:00100000:1.0:1788612440.871852:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612440.871887:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612440.871894:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.871901:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961302170000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612440.871904:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.871912:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612440.871920:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612440.871925:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612440.871949:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.871956:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612440.871972:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.871979:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff961302170000/0x1f8616bf0bc7df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e00 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872000:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612440.872003:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872009:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961302171c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612440.872012:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872020:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612440.872027:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612440.872034:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612440.872046:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872052:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612440.872058:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872065:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff961302171c00/0x1f8616bf0bc7dcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dd6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872073:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612440.872075:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612440.872076:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612440.872141:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788612440.872148:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:6517:x1875495932167680:12345-0@lo:104: Request processed in 611us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.872155:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612440.872169:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612440.872176:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6517:x1875495932167808:12345-0@lo:104: 00010000:00010000:2.0:1788612440.872184:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872231:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612440.872236:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:6517:x1875495932167808:12345-0@lo:104: Request processed in 62us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.872242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612440.872256:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612440.872262:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c18e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6517:x1875495932167936:12345-0@lo:104: 00010000:00010000:2.0:1788612440.872269:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872311:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612440.872317:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c18e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6517:x1875495932167936:12345-0@lo:104: Request processed in 56us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.872324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612440.872357:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612440.872362:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6517:x1875495932168064:12345-0@lo:104: 00010000:00010000:2.0:1788612440.872369:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872392:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788612440.872397:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6517:x1875495932168064:12345-0@lo:104: Request processed in 36us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.872403:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788612440.872432:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788612440.872436:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872442:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612440.872451:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872459:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612440.872465:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612440.872470:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612440.872530:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872537:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612440.872543:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872549:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c0030e00/0x1f8616bf0bc7db3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872559:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612440.872562:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872567:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4400 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612440.872570:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872576:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612440.872582:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612440.872594:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612440.872608:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872614:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612440.872619:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872625:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f4400/0x1f8616bf0bc7d74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d7b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872635:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612440.872637:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872642:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612440.872644:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872650:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612440.872655:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612440.872660:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612440.872670:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872676:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612440.872687:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872692:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d51 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.872707:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612440.872709:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612440.872711:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612440.872732:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167808:0@lo:104: 00000100:00100000:2.0:1788612440.872741:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932167936:0@lo:104: 00000100:00100000:2.0:1788612440.872748:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875495932168064:0@lo:104: 00010000:00010000:2.0:1788612440.872776:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.872936:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612440.873069:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932168448:0@lo:103: 00000100:00100000:1.0:1788612440.873100:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.873147:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167424 00000100:00100000:3.0:1788612440.873153:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167424 00010000:00010000:3.0:1788612440.873182:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 22 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612440.873215:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932167552 00000100:00100000:0.0:1788612440.873218:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932167552 00010000:00010000:0.0:1788612440.873234:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 23 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612440.873262:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612440.873269:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932167424:12345-0@lo:103: 00010000:00010000:0.0:1788612440.873278:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612440.873283:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 23 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.873303:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 23 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.873317:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe924e00/0x1f8616bf0bc7e46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7e3f expref: 23 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.873327:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612440.873355:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:3650:x1875495932167424:12345-0@lo:103: Request processed in 87us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612440.873360:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612440.873373:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612440.873379:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3650:x1875495932167552:12345-0@lo:103: 00010000:00010000:0.0:1788612440.873386:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612440.873390:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.873398:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.873418:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7e15 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.873427:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612440.873451:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3650:x1875495932167552:12345-0@lo:103: Request processed in 73us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612440.873456:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612440.873526:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932168576:0@lo:103: 00000100:00100000:1.0:1788612440.873721:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932167552:0@lo:103: 00000100:00100000:1.0:1788612440.873729:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932167424:0@lo:103: 00000100:00100000:2.0:1788612440.873789:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.873850:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168448 00000100:00100000:1.0:1788612440.873854:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168448 00010000:00010000:1.0:1788612440.873871:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 20 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612440.873894:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168576 00000100:00100000:1.0:1788612440.873904:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168576 00010000:00010000:1.0:1788612440.873916:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 21 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612440.873929:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612440.873935:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3650:x1875495932168448:12345-0@lo:103: 00010000:00010000:1.0:1788612440.873942:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612440.873946:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 21 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.873955:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 21 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.873965:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc7dba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7db3 expref: 21 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.873975:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612440.874005:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3650:x1875495932168448:12345-0@lo:103: Request processed in 70us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612440.874011:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612440.874023:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612440.874028:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9286850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3651:x1875495932168576:12345-0@lo:103: 00010000:00010000:1.0:1788612440.874035:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612440.874039:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 19 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.874045:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 19 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.874053:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc7d7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7d74 expref: 19 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.874068:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612440.874094:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9286850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3651:x1875495932168576:12345-0@lo:103: Request processed in 65us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612440.874100:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612440.874148:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932168448:0@lo:103: 00000100:00100000:2.0:1788612440.874208:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932168576:0@lo:103: 00000100:00100000:3.0:1788612440.874419:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932168192:0@lo:103: 00000100:00100000:3.0:1788612440.874451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.874559:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932168704:0@lo:103: 00000100:00100000:3.0:1788612440.874582:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612440.874644:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932168320:0@lo:103: 00000100:00100000:1.0:1788612440.874873:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.874887:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168192 00000100:00100000:2.0:1788612440.874891:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168192 00010000:00010000:2.0:1788612440.874910:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 18 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612440.874933:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168704 00000100:00100000:2.0:1788612440.874936:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168704 00010000:00010000:2.0:1788612440.874947:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 19 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612440.874965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612440.874972:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3648:x1875495932168192:12345-0@lo:103: 00010000:00010000:2.0:1788612440.874991:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612440.874997:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 19 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.875007:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 19 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.875020:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961302171600/0x1f8616bf0bc7e00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7df9 expref: 19 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.875032:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612440.875061:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3648:x1875495932168192:12345-0@lo:103: Request processed in 89us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.875067:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612440.875081:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612440.875088:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:3648:x1875495932168704:12345-0@lo:103: 00010000:00010000:2.0:1788612440.875095:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612440.875100:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.875109:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.875119:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030a00/0x1f8616bf0bc7d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7d4a expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.875128:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612440.875150:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3648:x1875495932168704:12345-0@lo:103: Request processed in 63us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.875156:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612440.875252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932168704:0@lo:103: 00000100:00100000:3.0:1788612440.875273:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932168192:0@lo:103: 00000100:00100000:2.0:1788612440.875434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168320 00000100:00100000:2.0:1788612440.875438:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168320 00010000:00010000:2.0:1788612440.875453:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 16 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612440.877275:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612440.878582:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3649:x1875495932168320:12345-0@lo:103: 00010000:00010000:2.0:1788612440.878611:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612440.878622:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 16 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878638:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 16 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878655:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961302171e00/0x1f8616bf0bc7dd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7dcf expref: 16 pid: 6518 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878670:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878678:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878696:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878702:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878709:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878734:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878740:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612440.878745:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878754:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878771:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.878781:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612440.878854:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3649:x1875495932168320:12345-0@lo:103: Request processed in 1567us (3979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.878864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788612440.878939:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.878948:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.878954:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897400/0x1f8616bf0bc7e5b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788612440.878967:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788612440.884937:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932168320:0@lo:103: 00000100:00100000:2.0:1788612440.888525:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:9516:x1875495932166912:12345-0@lo:253: Request processed in 25107us (25312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.888539:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788612440.888762:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932166912:0@lo:253: 10000000:01000000:3.0:1788612440.888777:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788612440.888780:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612440.888782:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612440.888783:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612440.888784:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788612440.888785:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612440.888801:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612440.888803:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612440.888804:0:9516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788612440.888806:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612440.888807:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788612440.888829:0:9516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9611c67e2000 from lustre-OST0001 10000000:01000000:3.0:1788612440.888860:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788612440.888863:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788612440.888872:0:9516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9612d1e64d40 local copy 10000000:01000000:3.0:1788612440.888876:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788612440.888910:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.888920:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.888929:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.888946:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932168832:0@lo:101: 00000100:00100000:3.0:1788612440.888983:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.889030:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.889084:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168832 00000100:00100000:2.0:1788612440.889091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168832 00000100:00100000:2.0:1788612440.889132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788612440.889141:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+14:9516:x1875495932168832:12345-0@lo:101: 00010000:00010000:2.0:1788612440.889153:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612440.889166:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc7e69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.889199:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc7e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e62 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.889210:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc7e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e62 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.889219:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1200, rc 0) 00000100:00100000:2.0:1788612440.889251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932168832:12345-0@lo:101: Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.889257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788612440.889346:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932168832:0@lo:101: 00010000:00010000:3.0:1788612440.889358:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.889367:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.889458:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932168960:0@lo:501: 00000100:00100000:3.0:1788612440.889521:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.889545:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.889657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932168960 00000100:00100000:2.0:1788612440.889662:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932168960 00000100:00100000:2.0:1788612440.889694:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788612440.889701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932168960:12345-0@lo:501: 00000100:00100000:2.0:1788612440.889755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932168960:12345-0@lo:501: Request processed in 54us (233us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612440.889762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788612440.889823:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932168960:0@lo:501: 10000000:01000000:3.0:1788612440.889835:0:9516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788612440.889852:0:9516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788612440.889857:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.889865:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.889871:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.889894:0:9516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788612440.889915:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9611c67e2000 10000000:01000000:3.0:1788612440.889919:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788612440.889924:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788612440.889927:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612440.889931:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788612440.889933:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788612440.889951:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.889957:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.889964:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.889974:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169088:0@lo:101: 00000100:00100000:3.0:1788612440.890006:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.890020:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.890033:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169088 00000100:00100000:3.0:1788612440.890036:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169088 00000100:00100000:3.0:1788612440.890058:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788612440.890063:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169088:12345-0@lo:101: 00010000:00010000:3.0:1788612440.890070:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612440.890079:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e70 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.890093:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.890101:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.890108:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897e00, rc 0) 00000100:00100000:3.0:1788612440.890133:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932169088:12345-0@lo:101: Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.890139:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788612440.890168:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169088:0@lo:101: 00010000:00010000:3.0:1788612440.890178:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.890185:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.890234:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169216:0@lo:501: 00000100:00100000:3.0:1788612440.890264:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.890277:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.890288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169216 00000100:00100000:3.0:1788612440.890292:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169216 00010000:00010000:2.0:1788612440.890584:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612440.890590:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.890597:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612440.890600:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.890608:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612440.890625:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612440.890630:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612440.890650:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.890655:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612440.890673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.890680:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1f8616bf0bc7e69 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.890692:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612440.890693:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612440.890695:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612440.890702:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612440.890711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932169344:0@lo:103: 00000100:00100000:2.0:1788612440.890736:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.890763:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169344 00000100:00100000:2.0:1788612440.890766:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169344 00000100:00100000:2.0:1788612440.890798:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612440.890805:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3648:x1875495932169344:12345-0@lo:103: 00010000:00010000:2.0:1788612440.890813:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612440.890824:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc7e69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc7e62 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.890833:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612440.890865:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3648:x1875495932169344:12345-0@lo:103: Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.890871:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612440.890896:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932169344:0@lo:103: 00000100:00100000:3.0:1788612440.890980:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788612440.890988:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169216:12345-0@lo:501: 00000100:00100000:3.0:1788612440.891078:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169216:12345-0@lo:501: Request processed in 90us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.891085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788612440.891115:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169216:0@lo:501: 00000100:00100000:3.0:1788612440.891142:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169472:0@lo:503: 00000100:00100000:3.0:1788612440.891180:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.891192:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.891238:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169472 00000100:00100000:2.0:1788612440.891243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169472 00000100:00100000:2.0:1788612440.891272:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788612440.891278:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169472:12345-0@lo:503: 00000100:00100000:2.0:1788612440.891361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169472:12345-0@lo:503: Request processed in 83us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.891367:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788612440.891521:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169472:0@lo:503: 00000040:00080000:3.0:1788612440.891764:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612440.891832:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169600:0@lo:502: 00000100:00100000:3.0:1788612440.891870:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.892131:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.892160:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169600 00000100:00100000:2.0:1788612440.892164:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169600 00000100:00100000:2.0:1788612440.892226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788612440.892233:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169600:12345-0@lo:502: 00000100:00100000:2.0:1788612440.892390:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169600:12345-0@lo:502: Request processed in 156us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.892396:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788612440.892455:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169600:0@lo:502: 00000040:00080000:3.0:1788612440.892660:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788612440.892685:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788612440.892699:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788612440.892711:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788612440.892724:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788612440.892737:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788612440.892757:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169728:0@lo:502: 00000100:00100000:3.0:1788612440.892799:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.894837:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612440.894909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169728 00000100:00100000:0.0:1788612440.894918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169728 00000100:00100000:0.0:1788612440.894962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788612440.894971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169728:12345-0@lo:502: 00000100:00100000:0.0:1788612440.895119:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169728:12345-0@lo:502: Request processed in 149us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612440.895127:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788612440.895218:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169728:0@lo:502: 00000040:00080000:3.0:1788612440.895295:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788612440.895320:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788612440.895915:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612440.895927:0:9527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788612440.895933:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612440.895935:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788612440.895944:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612440.895958:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9611c69d0000) 00000020:00000080:0.0:1788612440.895982:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788612440.895988:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788612440.896061:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c67e2000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788612440.896069:0:9527:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788612440.896084:0:9527:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1f8616bf0bc7e85 00010000:00010000:0.0:1788612440.900255:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788612440.900874:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788612440.905186:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788612440.905871:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788612440.911254:0:9527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788612440.911897:0:9527:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788612440.918791:0:9527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788612440.919815:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788612440.919827:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612440.919835:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612440.919837:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788612440.919840:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612440.919845:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612440.919846:0:9527:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788612440.919849:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788612440.919850:0:9527:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788612440.919875:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612440.919878:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612440.919879:0:9527:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788612440.919882:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788612440.920051:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788612440.920078:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788612440.920102:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920114:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612440.920122:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c67e2000 from 1 10000000:01000000:3.0:1788612440.920125:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612440.920159:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920168:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920178:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.920198:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169856:0@lo:101: 00000100:00100000:3.0:1788612440.920263:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.920378:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.920402:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169856 00000100:00100000:3.0:1788612440.920409:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169856 00000100:00100000:3.0:1788612440.920458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612440.920466:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932169856:12345-0@lo:101: 00010000:00010000:3.0:1788612440.920506:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612440.920518:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920539:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920549:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920558:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897200, rc 0) 00000100:00100000:3.0:1788612440.920599:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932169856:12345-0@lo:101: Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.920605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612440.920651:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169856:0@lo:101: 00010000:00010000:3.0:1788612440.920665:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.920673:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.920747:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169984:0@lo:501: 00000100:00100000:3.0:1788612440.920771:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.920785:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.920798:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932169984 00000100:00100000:3.0:1788612440.920802:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932169984 00000100:00100000:3.0:1788612440.920823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788612440.920836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932169984:12345-0@lo:501: 00000100:00100000:3.0:1788612440.920924:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932169984:12345-0@lo:501: Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.920931:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788612440.920962:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932169984:0@lo:501: 00000100:00100000:3.0:1788612440.920988:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170112:0@lo:503: 00000100:00100000:3.0:1788612440.921027:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.921040:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.921054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170112 00000100:00100000:3.0:1788612440.921058:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170112 00000100:00100000:3.0:1788612440.921082:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788612440.921088:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170112:12345-0@lo:503: 00000100:00100000:3.0:1788612440.921164:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170112:12345-0@lo:503: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.921169:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788612440.921212:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170112:0@lo:503: 00000040:00080000:3.0:1788612440.923586:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612440.923688:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170240:0@lo:502: 00000100:00100000:3.0:1788612440.923752:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.923784:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.923811:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170240 00000100:00100000:3.0:1788612440.923817:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170240 00000100:00100000:3.0:1788612440.923848:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788612440.923855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170240:12345-0@lo:502: 00000100:00100000:3.0:1788612440.923954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170240:12345-0@lo:502: Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.923969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788612440.924017:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170240:0@lo:502: 00000040:00080000:3.0:1788612440.924165:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788612440.924185:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788612440.924200:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170368:0@lo:502: 00000100:00100000:3.0:1788612440.924228:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.924240:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.924252:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170368 00000100:00100000:3.0:1788612440.924255:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170368 00000100:00100000:3.0:1788612440.924273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788612440.924278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170368:12345-0@lo:502: 00000100:00100000:3.0:1788612440.926553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170368:12345-0@lo:502: Request processed in 2266us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.926564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788612440.926710:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170368:0@lo:502: 00000040:00080000:2.0:1788612440.926788:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788612440.926801:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788612440.927464:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612440.927530:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612440.927533:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612440.927540:0:9531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c67e2000 00000020:00000080:3.0:1788612440.927542:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612440.927553:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612440.927556:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612440.927558:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788612440.927560:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788612440.927686:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788612440.927709:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612440.927775:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.927789:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612440.927843:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788612440.927846:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9611c67e2000 10000000:01000000:2.0:1788612440.927849:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9611c67e2000 10000000:01000000:2.0:1788612440.927852:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612440.927858:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9611c67e2000 from 1 10000000:01000000:2.0:1788612440.927861:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612440.927890:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.927897:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612440.927905:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612440.927923:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170496:0@lo:101: 00000100:00100000:2.0:1788612440.927973:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.928010:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.930854:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170496 00000100:00100000:3.0:1788612440.930866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170496 00000100:00100000:3.0:1788612440.930920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788612440.930930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9516:x1875495932170496:12345-0@lo:101: 00010000:00010000:3.0:1788612440.930947:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612440.930976:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7e9a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.931002:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.931012:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.931020:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897800, rc 0) 00000100:00100000:3.0:1788612440.931093:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170496:12345-0@lo:101: Request processed in 165us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.931100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788612440.931156:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170496:0@lo:101: 00010000:00010000:3.0:1788612440.931173:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.931183:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.931285:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170624:0@lo:501: 00000100:00100000:3.0:1788612440.931470:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.931592:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.931643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170624 00000100:00100000:2.0:1788612440.931648:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170624 00000100:00100000:2.0:1788612440.931679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788612440.931686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170624:12345-0@lo:501: 00000100:00100000:2.0:1788612440.931791:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170624:12345-0@lo:501: Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.931798:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788612440.931880:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170624:0@lo:501: 00000100:00100000:0.0:1788612440.931911:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170752:0@lo:503: 00000100:00100000:0.0:1788612440.931956:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612440.931980:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcd78e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612440.932023:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170752 00000100:00100000:2.0:1788612440.932028:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170752 00000100:00100000:2.0:1788612440.932061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788612440.932076:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170752:12345-0@lo:503: 00000100:00100000:2.0:1788612440.932157:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170752:12345-0@lo:503: Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.932164:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788612440.932207:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170752:0@lo:503: 00000040:00080000:2.0:1788612440.932579:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612440.932656:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170880:0@lo:502: 00000100:00100000:2.0:1788612440.932691:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.932711:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612440.932776:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932170880 00000100:00100000:0.0:1788612440.932782:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932170880 00000100:00100000:0.0:1788612440.932810:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788612440.932816:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170880:12345-0@lo:502: 00000100:00100000:0.0:1788612440.932889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932170880:12345-0@lo:502: Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612440.932895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788612440.932968:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932170880:0@lo:502: 00000040:00080000:2.0:1788612440.933145:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788612440.933173:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788612440.933191:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788612440.933207:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788612440.933222:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788612440.933237:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788612440.933252:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788612440.933266:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788612440.933282:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788612440.933727:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788612440.933750:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788612440.933764:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788612440.933775:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788612440.933786:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788612440.933796:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788612440.933807:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788612440.933819:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788612440.933831:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788612440.933842:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788612440.933866:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788612440.933879:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788612440.933891:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788612440.933902:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788612440.933914:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788612440.933928:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788612440.933940:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788612440.933953:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788612440.933965:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788612440.933976:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788612440.933987:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788612440.933997:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788612440.934009:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788612440.934023:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788612440.934037:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788612440.934051:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788612440.934063:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788612440.934073:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788612440.934084:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788612440.934096:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788612440.934126:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788612440.934141:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788612440.934153:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788612440.934167:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788612440.934180:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788612440.934193:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788612440.934205:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788612440.934234:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932171008:0@lo:502: 00000100:00100000:2.0:1788612440.934287:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612440.934426:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612440.934669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171008 00000100:00100000:0.0:1788612440.934676:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171008 00000100:00100000:0.0:1788612440.934750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612440.934759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932171008:12345-0@lo:502: 00000100:00100000:0.0:1788612440.934866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932171008:12345-0@lo:502: Request processed in 107us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612440.934874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788612440.934950:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932171008:0@lo:502: 00000040:00080000:3.0:1788612440.935006:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788612440.935015:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788612440.935519:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788612440.935535:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9612ea248000) 00000020:00000080:3.0:1788612440.935557:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788612440.935664:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c67e2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788612440.935669:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c67e2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788612440.935671:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c67e2000 3 00010000:00080000:3.0:1788612440.935700:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96130066b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612440.937774:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788612440.937993:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788612440.938037:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788612440.938050:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1f8616bf0bc7eaf 00000100:00080000:3.0:1788612440.938060:0:9532:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612440.938067:0:9532:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96130066b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612440.938103:0:9532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed70a80 x1875495932171136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612440.938144:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932171136:0@lo:38: 00000100:00100000:3.0:1788612440.938207:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.938270:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171136 00000100:00100000:3.0:1788612440.938277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171136 00000100:00100000:3.0:1788612440.938309:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612440.938316:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932171136:12345-0@lo:38: 00010000:00080000:3.0:1788612440.938338:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1788612440.938362:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1f8616bf0bc7eb6 00000004:00100000:3.0:1788612440.938374:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612440.938400:0:6523:0:(import.c:65:import_set_state_nolock()) ffff96130168f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612440.938442:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875495932171136:12345-0@lo:38: Request processed in 125us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.938448:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788612440.940544:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00080000:3.0:1788612440.940697:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed70a80 x1875495932171136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612440.940723:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612440.940732:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788612440.940740:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788612440.940746:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612440.940749:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612440.940755:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932171136:0@lo:38: 00000100:00100000:2.0:1788612440.940840:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932171264:0@lo:400: 00000100:00100000:2.0:1788612440.940894:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.941101:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932171392:0@lo:400: 00000100:00100000:1.0:1788612440.941129:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.943549:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171392 00000100:00100000:1.0:1788612440.943562:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171392 00000100:00100000:1.0:1788612440.943609:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612440.943618:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932171392:12345-0@lo:400: 00000100:00100000:1.0:1788612440.943701:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932171392:12345-0@lo:400: Request processed in 82us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612440.943708:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612440.943731:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171264 00000100:00100000:1.0:1788612440.943734:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171264 00000100:00100000:1.0:1788612440.943762:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612440.943768:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932171264:12345-0@lo:400: 00000100:00100000:3.0:1788612440.945095:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932171648:0@lo:400: 00000100:00100000:3.0:1788612440.945147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.945174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932172160:0@lo:400: 00000100:00100000:3.0:1788612440.945199:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.945222:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788612440.945229:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932171520:0@lo:400: 00000100:00100000:3.0:1788612440.945266:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.945284:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932172032:0@lo:400: 00000100:00100000:3.0:1788612440.945320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.945350:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172160 00000100:00100000:3.0:1788612440.945355:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172160 00000100:00100000:3.0:1788612440.945389:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172032 00000100:00100000:3.0:1788612440.945393:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172032 00000100:00100000:3.0:1788612440.945413:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612440.945422:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932172160:12345-0@lo:400: 00000100:00100000:3.0:1788612440.945463:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932172160:12345-0@lo:400: Request processed in 42us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.945470:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612440.945516:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612440.945529:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932172032:12345-0@lo:400: 00000100:00100000:3.0:1788612440.945558:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932172032:12345-0@lo:400: Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.945563:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788612440.945607:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed70380 x1875495932172032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612440.945619:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932172032:0@lo:400: 00010000:00080000:3.0:1788612440.945629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73b80 x1875495932172160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612440.945635:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932172160:0@lo:400: 00000100:00100000:3.0:1788612440.945658:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171648 00000100:00100000:3.0:1788612440.945663:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171648 00000100:00100000:3.0:1788612440.945681:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612440.945687:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932171648:12345-0@lo:400: 00000100:00100000:3.0:1788612440.945721:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932171648:12345-0@lo:400: Request processed in 33us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.945728:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612440.945750:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932171648:0@lo:400: 00000100:00100000:3.0:1788612440.945770:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171520 00000100:00100000:3.0:1788612440.945773:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171520 00000100:00100000:3.0:1788612440.945795:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612440.945801:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932171520:12345-0@lo:400: 00000100:00100000:3.0:1788612440.945834:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932171520:12345-0@lo:400: Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.945840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788612440.945875:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71500 x1875495932171520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612440.945885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932171520:0@lo:400: 00000100:00100000:1.0:1788612440.946048:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932171264:12345-0@lo:400: Request processed in 2279us (5152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612440.946055:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612440.946077:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932171904:0@lo:400: 00000100:00100000:1.0:1788612440.946103:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.946136:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932171392:0@lo:400: 00000100:00100000:1.0:1788612440.946155:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612440.946161:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932171776:0@lo:400: 00000100:00100000:1.0:1788612440.946184:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.946207:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171904 00000100:00100000:1.0:1788612440.946211:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171904 00000100:00100000:1.0:1788612440.946232:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932171776 00000100:00100000:1.0:1788612440.946235:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932171776 00000100:00100000:1.0:1788612440.946247:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612440.946252:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932171904:12345-0@lo:400: 00000100:00100000:1.0:1788612440.946281:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932171904:12345-0@lo:400: Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612440.946287:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612440.946358:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612440.946365:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932171776:12345-0@lo:400: 00000100:00100000:1.0:1788612440.946395:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932171776:12345-0@lo:400: Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612440.946401:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788612440.946426:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed72680 x1875495932171776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612440.946437:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932171776:0@lo:400: 00010000:00080000:1.0:1788612440.946447:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71c00 x1875495932171904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612440.946456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932171904:0@lo:400: 00010000:00080000:2.0:1788612440.947079:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed70a80 x1875495932171264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612440.947091:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932171264:0@lo:400: 00000020:01000004:2.0:1788612440.947261:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788612440.947276:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9611c64b99c0) 00000020:00000080:2.0:1788612440.947311:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788612440.947395:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c67e2000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788612440.947399:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c67e2000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788612440.947401:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c67e2000 3 00010000:00080000:2.0:1788612440.947426:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c75c7000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612440.949759:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788612440.949956:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788612440.949999:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612440.950012:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1f8616bf0bc7ec4 00000100:00080000:2.0:1788612440.950022:0:9532:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612440.950027:0:9532:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9611c75c7000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612440.950060:0:9532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed4ea00 x1875495932172288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612440.950087:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788612440.950416:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932172288:0@lo:38: 00000100:00100000:0.0:1788612440.950528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.953299:0:9534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875495932172416:0@lo:901: 00000100:00100000:3.0:1788612440.953704:0:9534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.953994:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172416 00000100:00100000:3.0:1788612440.954003:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172416 00000100:00100000:3.0:1788612440.954122:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612440.954134:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875495932172416:12345-0@lo:901: 00000100:00100000:3.0:1788612440.954227:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875495932172416:12345-0@lo:901: Request processed in 97us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.954235:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788612440.954256:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612440.954268:0:9534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a956c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788612440.954291:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71500 x1875495932172416/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788612456 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612440.954304:0:9534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875495932172416:0@lo:901: 00000100:00100000:2.0:1788612440.956793:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172288 00000100:00100000:2.0:1788612440.956805:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172288 00000100:00100000:2.0:1788612440.956850:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612440.956858:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875495932172288:12345-0@lo:38: 00010000:00080000:2.0:1788612440.956887:0:8253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:2.0:1788612440.956923:0:8253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1f8616bf0bc7ecb 00000004:00100000:2.0:1788612440.956939:0:8253:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788612440.956979:0:8253:0:(import.c:65:import_set_state_nolock()) ffff9611c75c3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612440.957068:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875495932172288:12345-0@lo:38: Request processed in 208us (6539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.957075:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1788612440.957182:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788612440.957420:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788612440.957445:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788612440.957463:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.957510:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788612440.957558:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788612440.957560:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612440.957561:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612440.957562:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612440.957564:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612440.957565:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612440.957567:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612440.957568:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612440.957569:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612440.957571:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612440.957572:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788612440.957575:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788612440.957578:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788612440.957579:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612440.957580:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612440.957582:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612440.957583:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612440.957584:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612440.957585:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612440.957586:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612440.957587:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612440.957588:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612440.957589:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788612440.957609:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788612440.957624:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932172544:0@lo:253: 00000100:00100000:1.0:1788612440.957664:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.957695:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d780 going to sleep for 11 seconds 00010000:00080000:3.0:1788612440.957839:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed4ea00 x1875495932172288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612440.957850:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612440.957857:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788612440.957864:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788612440.957868:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788612440.957871:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c75c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612440.957877:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932172288:0@lo:38: 00000100:00100000:2.0:1788612440.957983:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172544 00000100:00100000:2.0:1788612440.957988:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172544 00000100:00100000:2.0:1788612440.958052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788612440.958060:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9516:x1875495932172544:12345-0@lo:253: 20000000:01000000:2.0:1788612440.958079:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788612440.958092:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788612440.963309:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788612440.963326:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788612440.963436:0:6539:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788612440.963441:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788612440.963462:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.963538:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.963545:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.963553:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.963589:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.963601:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 17 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612440.963614:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932172672:0@lo:104: 00000100:00100000:1.0:1788612440.963668:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612440.963712:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.963720:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 17 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612440.963728:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932172800:0@lo:104: 00000100:00100000:1.0:1788612440.963744:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612440.963759:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612440.963860:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172672 00000100:00100000:3.0:1788612440.963867:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172672 00000100:00100000:3.0:1788612440.963897:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172800 00000100:00100000:3.0:1788612440.963899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172800 00000100:00100000:3.0:1788612440.963910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612440.963917:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6539:x1875495932172672:12345-0@lo:104: 00010000:00010000:3.0:1788612440.963929:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.963978:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612440.963984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:6539:x1875495932172672:12345-0@lo:104: Request processed in 67us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.963990:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612440.964004:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612440.964009:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932172800:12345-0@lo:104: 00010000:00010000:3.0:1788612440.964015:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964041:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788612440.964046:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:6539:x1875495932172800:12345-0@lo:104: Request processed in 37us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.964051:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788612440.964064:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612440.964070:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964076:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961302171800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612440.964080:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964094:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612440.964101:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612440.964107:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612440.964130:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964136:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612440.964150:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964157:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff961302171800/0x1f8616bf0bc7e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e0e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964169:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612440.964172:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964177:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612440.964180:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964186:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612440.964192:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612440.964202:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612440.964215:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964221:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612440.964225:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964232:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c0031a00/0x1f8616bf0bc7dc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7dc8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964244:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612440.964245:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612440.964247:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612440.964257:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932173056:0@lo:103: 00000100:00100000:3.0:1788612440.964281:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.964297:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612440.964302:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932172928:0@lo:103: 00000100:00100000:3.0:1788612440.964317:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612440.964337:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173056 00000100:00100000:3.0:1788612440.964340:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173056 00010000:00010000:3.0:1788612440.964353:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 18 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.964370:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932172928 00000100:00100000:3.0:1788612440.964372:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932172928 00010000:00010000:3.0:1788612440.964380:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 19 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612440.964393:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612440.964404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3651:x1875495932173056:12345-0@lo:103: 00010000:00010000:3.0:1788612440.964413:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612440.964417:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 19 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964426:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 19 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964439:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612440.964460:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3651:x1875495932173056:12345-0@lo:103: Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.964466:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612440.964510:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612440.964517:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3651:x1875495932172928:12345-0@lo:103: 00010000:00010000:3.0:1788612440.964523:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612440.964528:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 18 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964537:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 18 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964548:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964556:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612440.964566:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016303027s 00010000:00010000:3.0:1788612440.964570:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964586:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964593:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964600:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964605:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612440.964609:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964616:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964623:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612440.964630:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612440.964650:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3651:x1875495932172928:12345-0@lo:103: Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612440.964655:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612440.964697:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932172928:0@lo:103: 00000100:00100000:3.0:1788612440.964704:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932173056:0@lo:103: 00010000:00010000:1.0:1788612440.964775:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961302170600/0x1f8616bf0bc7e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7e07 expref: 17 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612440.964803:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932172672:0@lo:104: 00010000:00010000:1.0:1788612440.964811:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc7dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7dc1 expref: 16 pid: 6517 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612440.964819:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875495932172800:0@lo:104: 00010000:00010000:1.0:1788612440.964831:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.964840:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.964846:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612440.964852:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc7ed2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612440.964954:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612440.965182:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:9516:x1875495932172544:12345-0@lo:253: Request processed in 7122us (7516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612440.965191:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788612440.965255:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d04a0405-b620-42fe-8569-8c55f54b9b5e:9516:1875495932172544:0@lo:253: 10000000:01000000:1.0:1788612440.965264:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788612440.965267:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612440.965268:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612440.965270:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612440.965271:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612440.965272:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612440.965273:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612440.965274:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612440.965276:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612440.965277:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612440.965278:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612440.965279:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788612440.965289:0:9516:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788612440.972900:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788612440.973075:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788612440.973279:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788612440.973439:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788612440.973691:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788612440.974081:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788612440.977338:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788612440.986032:0:9516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788612440.986042:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788612440.986079:0:9516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788612440.986127:0:9516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788612440.986144:0:9516:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788612440.986164:0:9516:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788612440.986971:0:9516:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612440.987162:0:9516:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788612441.455768:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612441.805377:0:9588:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612441.806312:0:9588:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788612442.096671:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612442.096699:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932173184:0@lo:41: 00000100:00100000:2.0:1788612442.096766:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612442.096831:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173184 00000100:00100000:2.0:1788612442.096838:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173184 00000100:00100000:2.0:1788612442.096882:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612442.096890:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932173184:12345-0@lo:41: 00000004:00000024:2.0:1788612442.096920:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788612442.096963:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932173184:12345-0@lo:41: Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612442.096970:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612442.097025:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932173184:0@lo:41: 00010000:00010000:1.0:1788612442.481979:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612443.503944:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612444.143827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932173312:0@lo:41: 00000100:00100000:2.0:1788612444.143901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612444.143974:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173312 00000100:00100000:2.0:1788612444.143982:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173312 00000100:00100000:2.0:1788612444.144027:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612444.144037:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932173312:12345-0@lo:41: 00000004:00000024:2.0:1788612444.144068:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788612444.144110:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932173312:12345-0@lo:41: Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612444.144116:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612444.144169:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932173312:0@lo:41: 00000100:00100000:2.0:1788612444.144227:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932173440:0@lo:13: 00000100:00100000:2.0:1788612444.144253:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612444.144295:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173440 00000100:00100000:2.0:1788612444.144299:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173440 00000100:00100000:2.0:1788612444.144336:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612444.144342:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932173440:12345-0@lo:13: 00002000:00000024:2.0:1788612444.144360:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612444.144392:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932173440:12345-0@lo:13: Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612444.144398:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788612444.144411:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788612444.144433:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4d880 x1875495932173440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612444.144448:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932173440:0@lo:13: 00000100:00100000:2.0:1788612444.144654:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932173568:0@lo:13: 00000100:00100000:2.0:1788612444.144682:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612444.144752:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173568 00000100:00100000:1.0:1788612444.144757:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173568 00000100:00100000:1.0:1788612444.144795:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612444.144803:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932173568:12345-0@lo:13: 00002000:00000024:1.0:1788612444.144814:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612444.144849:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932173568:12345-0@lo:13: Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612444.144855:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788612444.144880:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0a80 x1875495932173568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612444.144893:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932173568:0@lo:13: 00000100:00080000:2.0:1788612444.144952:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788612444.527624:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612445.551740:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612446.193265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932173824:0@lo:400: 00000100:00100000:2.0:1788612446.193338:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612446.193395:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932174336:0@lo:400: 00000100:00100000:2.0:1788612446.193442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.193592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932173696:0@lo:400: 00000100:00100000:3.0:1788612446.193636:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.193714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932173952:0@lo:400: 00000100:00100000:3.0:1788612446.193740:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.193780:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173824 00000100:00100000:3.0:1788612446.193788:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173824 00000100:00100000:3.0:1788612446.193833:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174336 00000100:00100000:3.0:1788612446.193836:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174336 00000100:00100000:3.0:1788612446.193867:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612446.193876:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932173824:12345-0@lo:400: 00000100:00100000:3.0:1788612446.193935:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932173824:12345-0@lo:400: Request processed in 59us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.193942:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612446.193957:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612446.193964:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932174336:12345-0@lo:400: 00000100:00100000:3.0:1788612446.193994:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932174336:12345-0@lo:400: Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.194001:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612446.194029:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173952 00000100:00100000:3.0:1788612446.194033:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173952 00010000:00080000:2.0:1788612446.194046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4ca80 x1875495932174336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612446.194063:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788612446.194063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932174336:0@lo:400: 00000100:00100000:3.0:1788612446.194076:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932173952:12345-0@lo:400: 00000100:00100000:2.0:1788612446.194078:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932174848:0@lo:400: 00000100:00100000:3.0:1788612446.194129:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932173952:12345-0@lo:400: Request processed in 54us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612446.194129:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194139:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612446.194161:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174848 00000100:00100000:3.0:1788612446.194166:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174848 00010000:00080000:2.0:1788612446.194177:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4d180 x1875495932173824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612446.194189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932173824:0@lo:400: 00000100:00100000:3.0:1788612446.194194:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612446.194204:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932174848:12345-0@lo:400: 00000100:00100000:3.0:1788612446.194252:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932174848:12345-0@lo:400: Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.194258:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788612446.194274:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612446.194299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932173952:0@lo:400: 00000100:00100000:3.0:1788612446.194308:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932174464:0@lo:400: 00000100:00100000:3.0:1788612446.194347:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194368:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932174976:0@lo:400: 00000100:00100000:3.0:1788612446.194387:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194416:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788612446.194422:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932174080:0@lo:400: 00000100:00100000:3.0:1788612446.194442:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194465:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932174592:0@lo:400: 00000100:00100000:3.0:1788612446.194508:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194534:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174592 00000100:00100000:3.0:1788612446.194537:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174592 00000100:00100000:3.0:1788612446.194563:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612446.194570:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932174592:12345-0@lo:400: 00000100:00100000:3.0:1788612446.194603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932174592:12345-0@lo:400: Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.194610:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612446.194616:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174464 00000100:00100000:1.0:1788612446.194623:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174464 00000100:00100000:3.0:1788612446.194633:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174976 00000100:00100000:3.0:1788612446.194638:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174976 00000100:00100000:1.0:1788612446.194657:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174080 00000100:00100000:3.0:1788612446.194663:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612446.194664:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174080 00000100:00100000:3.0:1788612446.194672:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932174464:12345-0@lo:400: 00000100:00100000:1.0:1788612446.194693:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612446.194704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932174976:12345-0@lo:400: 00000100:00100000:3.0:1788612446.194706:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932174464:12345-0@lo:400: Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.194722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612446.194740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788612446.194749:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932174080:12345-0@lo:400: 00000100:00100000:1.0:1788612446.194755:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932174976:12345-0@lo:400: Request processed in 50us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612446.194772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788612446.194789:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932174080:12345-0@lo:400: Request processed in 40us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.194796:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788612446.194813:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612446.194816:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612446.194830:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932174208:0@lo:400: 00000100:00100000:3.0:1788612446.194853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932174720:0@lo:400: 00000100:00100000:3.0:1788612446.194896:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612446.194919:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174720 00000100:00100000:3.0:1788612446.194922:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174720 00000100:00100000:3.0:1788612446.194947:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612446.194953:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932174720:12345-0@lo:400: 00000100:00100000:3.0:1788612446.194980:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932174720:12345-0@lo:400: Request processed in 27us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.194985:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788612446.194999:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612446.195018:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932174208 00010000:00080000:3.0:1788612446.195024:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4f800 x1875495932174720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612446.195026:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932174208 00000100:00100000:3.0:1788612446.195038:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932174720:0@lo:400: 00000100:00100000:1.0:1788612446.195068:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788612446.195072:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4e300 x1875495932174080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612446.195081:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932174208:12345-0@lo:400: 00000100:00100000:3.0:1788612446.195086:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932174080:0@lo:400: 00010000:00080000:3.0:1788612446.195106:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4f100 x1875495932174592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612446.195115:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932174592:0@lo:400: 00010000:00080000:3.0:1788612446.195127:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4e680 x1875495932174464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612446.195136:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932174208:12345-0@lo:400: Request processed in 57us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612446.195139:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932174464:0@lo:400: 00000100:00100000:1.0:1788612446.195152:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788612446.195156:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe976d80 x1875495932174976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612446.195165:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932174976:0@lo:400: 00000100:00100000:1.0:1788612446.195196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932174208:0@lo:400: 00010000:00080000:3.0:1788612446.195204:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe975c00 x1875495932174848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612446.195214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932174848:0@lo:400: 00000100:00100000:0.0:1788612446.196640:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932173696 00000100:00100000:0.0:1788612446.196653:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932173696 00000100:00100000:0.0:1788612446.196714:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612446.196850:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3648:x1875495932173696:12345-0@lo:400: 00000100:00100000:0.0:1788612446.197605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3648:x1875495932173696:12345-0@lo:400: Request processed in 879us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612446.197615:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788612446.199507:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932173696:0@lo:400: 00000001:02000400:3.0:1788612446.367932:0:9877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788612446.576407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612447.222846:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612447.222876:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932175104:0@lo:41: 00000100:00100000:3.0:1788612447.222948:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612447.223266:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175104 00000100:00100000:0.0:1788612447.223274:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175104 00000100:00100000:0.0:1788612447.223326:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612447.223336:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932175104:12345-0@lo:41: 00000004:00000024:0.0:1788612447.223369:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788612447.223419:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932175104:12345-0@lo:41: Request processed in 84us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612447.223427:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612447.223776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932175104:0@lo:41: 00000020:00000004:0.0:1788612447.254372:0:9930:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612447.254643:0:9930:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788612447.601288:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612448.623710:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612448.751623:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788612448.751632:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fcfb4000 from 39 10000000:01000000:3.0:1788612448.751638:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612448.751688:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.751701:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.751727:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.751761:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175232:0@lo:101: 00000100:00100000:3.0:1788612448.752033:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.752092:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.752195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175232 00000100:00100000:2.0:1788612448.752202:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175232 00000100:00100000:2.0:1788612448.752249:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788612448.752269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932175232:12345-0@lo:101: 00010000:00010000:2.0:1788612448.752474:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612448.752534:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7ed9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.752561:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.752583:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.752592:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1c00, rc 0) 00000100:00100000:2.0:1788612448.752647:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932175232:12345-0@lo:101: Request processed in 391us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.752654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788612448.753028:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175232:0@lo:101: 00010000:00010000:3.0:1788612448.753046:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.753055:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.753118:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175360:0@lo:501: 00000100:00100000:3.0:1788612448.753148:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.753181:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.753282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175360 00000100:00100000:0.0:1788612448.753494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175360 00000100:00100000:0.0:1788612448.753548:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788612448.753557:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932175360:12345-0@lo:501: 00000100:00100000:0.0:1788612448.753692:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932175360:12345-0@lo:501: Request processed in 134us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.753699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788612448.754104:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175360:0@lo:501: 00000100:00100000:3.0:1788612448.754154:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175488:0@lo:503: 00000100:00100000:3.0:1788612448.754192:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.754223:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612448.754552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175488 00000100:00100000:1.0:1788612448.754559:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175488 00000100:00100000:1.0:1788612448.754631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612448.754639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932175488:12345-0@lo:503: 00000100:00100000:1.0:1788612448.755105:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932175488:12345-0@lo:503: Request processed in 466us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.755113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788612448.755242:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175488:0@lo:503: 00000100:00100000:1.0:1788612448.756191:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9982:1875495932175616:0@lo:502: 00000100:00100000:1.0:1788612448.756269:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.756321:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.756448:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175616 00000100:00100000:2.0:1788612448.756455:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175616 00000100:00100000:2.0:1788612448.756516:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788612448.756533:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9982:x1875495932175616:12345-0@lo:502: 00000100:00100000:2.0:1788612448.756649:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9982:x1875495932175616:12345-0@lo:502: Request processed in 117us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.756656:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788612448.756956:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9982:1875495932175616:0@lo:502: 00000100:00100000:1.0:1788612448.757003:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9982:1875495932175744:0@lo:502: 00000100:00100000:1.0:1788612448.757035:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.757071:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.757125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175744 00000100:00100000:0.0:1788612448.757129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175744 00000100:00100000:0.0:1788612448.757160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788612448.757167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9982:x1875495932175744:12345-0@lo:502: 00000100:00100000:0.0:1788612448.757250:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:9982:x1875495932175744:12345-0@lo:502: Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.757257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788612448.757441:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9982:1875495932175744:0@lo:502: 00000040:00080000:1.0:1788612448.757461:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788612448.757636:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788612448.757657:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612448.757668:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.757695:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612448.757706:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788612448.757709:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788612448.757713:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788612448.757743:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.757753:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.757765:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.757780:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175872:0@lo:101: 00000100:00100000:3.0:1788612448.757808:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.757845:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.758191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932175872 00000100:00100000:0.0:1788612448.758196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932175872 00000100:00100000:0.0:1788612448.758229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788612448.758236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932175872:12345-0@lo:101: 00010000:00010000:0.0:1788612448.758246:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612448.758258:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7ee7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612448.758279:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612448.758301:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612448.758310:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924c00, rc 0) 00000100:00100000:0.0:1788612448.758356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932175872:12345-0@lo:101: Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.758362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788612448.758528:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932175872:0@lo:101: 00010000:00010000:1.0:1788612448.758542:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.758551:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612448.758599:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176000:0@lo:501: 00000100:00100000:1.0:1788612448.758626:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.758644:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.758691:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176000 00000100:00100000:3.0:1788612448.758695:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176000 00000100:00100000:3.0:1788612448.758713:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788612448.758718:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932176000:12345-0@lo:501: 00000100:00100000:3.0:1788612448.758842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932176000:12345-0@lo:501: Request processed in 122us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.758849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788612448.758979:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176000:0@lo:501: 00000100:00100000:1.0:1788612448.759003:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176128:0@lo:503: 00000100:00100000:1.0:1788612448.759039:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.759057:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.759162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176128 00000100:00100000:2.0:1788612448.759166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176128 00000100:00100000:2.0:1788612448.759186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788612448.759192:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932176128:12345-0@lo:503: 00000100:00100000:2.0:1788612448.759272:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932176128:12345-0@lo:503: Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.759279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788612448.759377:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176128:0@lo:503: 00000100:00100000:1.0:1788612448.759584:0:9983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9983:1875495932176256:0@lo:502: 00000100:00100000:1.0:1788612448.759617:0:9983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.759633:0:9983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.759708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176256 00000100:00100000:2.0:1788612448.759712:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176256 00000100:00100000:2.0:1788612448.759809:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788612448.759992:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9983:x1875495932176256:12345-0@lo:502: 00000100:00100000:2.0:1788612448.760095:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9983:x1875495932176256:12345-0@lo:502: Request processed in 107us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.760110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788612448.760575:0:9983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9983:1875495932176256:0@lo:502: 00000020:01000000:1.0:1788612448.760601:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612448.760609:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612448.760612:0:9983:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788612448.760616:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788612448.760623:0:9983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788612448.760642:0:9983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9983:1875495932176384:0@lo:502: 00000100:00100000:1.0:1788612448.760680:0:9983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.760711:0:9983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea1d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.760764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176384 00000100:00100000:2.0:1788612448.760769:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176384 00000100:00100000:2.0:1788612448.760802:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788612448.760809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9983:x1875495932176384:12345-0@lo:502: 00000100:00100000:2.0:1788612448.761151:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:9983:x1875495932176384:12345-0@lo:502: Request processed in 341us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.761158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788612448.761521:0:9983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9983:1875495932176384:0@lo:502: 00000020:01000000:1.0:1788612448.761545:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612448.761550:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612448.761552:0:9983:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788612448.761557:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788612448.761795:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788612448.761966:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788612448.761977:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.761987:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612448.761997:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788612448.761999:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fccf8000 from 39 10000000:01000000:2.0:1788612448.762002:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612448.762032:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.762041:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.762050:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612448.762065:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176512:0@lo:101: 00000100:00100000:2.0:1788612448.762110:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.762190:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.762228:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176512 00000100:00100000:3.0:1788612448.762234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176512 00000100:00100000:3.0:1788612448.762520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788612448.762538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932176512:12345-0@lo:101: 00010000:00010000:3.0:1788612448.762548:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612448.762559:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7ef5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.762580:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.762591:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.762599:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897600, rc 0) 00000100:00100000:3.0:1788612448.762634:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932176512:12345-0@lo:101: Request processed in 98us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.762640:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788612448.762711:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176512:0@lo:101: 00010000:00010000:2.0:1788612448.762725:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.762744:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612448.762795:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176640:0@lo:501: 00000100:00100000:2.0:1788612448.762839:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.763097:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.763148:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176640 00000100:00100000:0.0:1788612448.763152:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176640 00000100:00100000:0.0:1788612448.763175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788612448.763182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932176640:12345-0@lo:501: 00000100:00100000:0.0:1788612448.763321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932176640:12345-0@lo:501: Request processed in 139us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.763328:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788612448.763407:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176640:0@lo:501: 00000100:00100000:2.0:1788612448.763445:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176768:0@lo:503: 00000100:00100000:2.0:1788612448.763510:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.763526:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.763713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176768 00000100:00100000:0.0:1788612448.763717:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176768 00000100:00100000:0.0:1788612448.763747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788612448.763755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932176768:12345-0@lo:503: 00000100:00100000:0.0:1788612448.763959:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932176768:12345-0@lo:503: Request processed in 205us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.763965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788612448.764168:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932176768:0@lo:503: 00000100:00100000:2.0:1788612448.764560:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9984:1875495932176896:0@lo:502: 00000100:00100000:2.0:1788612448.764599:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.764624:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.764761:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932176896 00000100:00100000:0.0:1788612448.764765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932176896 00000100:00100000:0.0:1788612448.764797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788612448.764804:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:9984:x1875495932176896:12345-0@lo:502: 00000100:00100000:0.0:1788612448.765127:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:9984:x1875495932176896:12345-0@lo:502: Request processed in 323us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.765134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788612448.765214:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9984:1875495932176896:0@lo:502: 00000100:00100000:2.0:1788612448.765256:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9984:1875495932177024:0@lo:502: 00000100:00100000:2.0:1788612448.765307:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.765330:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.765378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177024 00000100:00100000:3.0:1788612448.765383:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177024 00000100:00100000:3.0:1788612448.765414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788612448.765421:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:9984:x1875495932177024:12345-0@lo:502: 00000100:00100000:3.0:1788612448.765526:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:9984:x1875495932177024:12345-0@lo:502: Request processed in 106us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.765532:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788612448.765758:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9984:1875495932177024:0@lo:502: 00000040:00080000:2.0:1788612448.765782:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788612448.766088:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788612448.766109:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612448.766118:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.766128:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612448.766149:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612448.766151:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612fccf8000 from 6 10000000:01000000:3.0:1788612448.766154:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612448.766178:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.766185:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.766194:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.766207:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177152:0@lo:101: 00000100:00100000:3.0:1788612448.766234:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.766266:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.766416:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177152 00000100:00100000:2.0:1788612448.766420:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177152 00000100:00100000:2.0:1788612448.766463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788612448.766470:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932177152:12345-0@lo:101: 00010000:00010000:2.0:1788612448.766508:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612448.766520:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0800/0x1f8616bf0bc7f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7f03 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.766541:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0800/0x1f8616bf0bc7f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f03 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.766551:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0800/0x1f8616bf0bc7f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f03 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.766558:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0800, rc 0) 00000100:00100000:2.0:1788612448.766585:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932177152:12345-0@lo:101: Request processed in 116us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.766592:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788612448.768146:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177152:0@lo:101: 00010000:00010000:3.0:1788612448.768171:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.768181:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.768250:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177280:0@lo:256: 00000100:00100000:3.0:1788612448.768452:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.768530:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.769496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177280 00000100:00100000:2.0:1788612448.769507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177280 00000100:00100000:2.0:1788612448.769565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788612448.769574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932177280:12345-0@lo:256: 20000000:01000000:2.0:1788612448.769593:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788612448.769612:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788612448.769615:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788612448.769729:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932177280:12345-0@lo:256: Request processed in 156us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.770056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788612448.772243:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177280:0@lo:256: 10000000:01000000:3.0:1788612448.772456:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612448.772495:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.772506:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612448.772516:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788612448.772529:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788612448.772533:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788612448.772575:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.772584:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.772594:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.772614:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177408:0@lo:101: 00000100:00100000:3.0:1788612448.772673:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.772710:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.772858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177408 00000100:00100000:0.0:1788612448.772864:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177408 00000100:00100000:0.0:1788612448.772915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788612448.772924:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932177408:12345-0@lo:101: 00010000:00010000:0.0:1788612448.772937:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612448.772950:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7f11 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612448.772973:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612448.772983:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612448.772991:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe925800, rc 0) 00000100:00100000:0.0:1788612448.773036:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932177408:12345-0@lo:101: Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.773043:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788612448.773513:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177408:0@lo:101: 00010000:00010000:3.0:1788612448.773529:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.773910:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.773981:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177536:0@lo:501: 00000100:00100000:3.0:1788612448.774020:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.774051:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.774269:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177536 00000100:00100000:0.0:1788612448.774274:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177536 00000100:00100000:0.0:1788612448.774390:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788612448.774399:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932177536:12345-0@lo:501: 00000100:00100000:0.0:1788612448.775038:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932177536:12345-0@lo:501: Request processed in 638us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.775046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788612448.775188:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177536:0@lo:501: 00000100:00100000:2.0:1788612448.775225:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177664:0@lo:503: 00000100:00100000:2.0:1788612448.775279:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.775446:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.775500:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177664 00000100:00100000:0.0:1788612448.775505:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177664 00000100:00100000:0.0:1788612448.775721:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788612448.775730:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932177664:12345-0@lo:503: 00000100:00100000:0.0:1788612448.776036:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932177664:12345-0@lo:503: Request processed in 306us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.776043:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612448.776144:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932177664:0@lo:503: 00000100:00100000:2.0:1788612448.777067:0:9985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9985:1875495932177792:0@lo:502: 00000100:00100000:2.0:1788612448.777117:0:9985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.777152:0:9985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.777201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177792 00000100:00100000:3.0:1788612448.777206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177792 00000100:00100000:3.0:1788612448.777245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788612448.777426:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:9985:x1875495932177792:12345-0@lo:502: 00000100:00100000:3.0:1788612448.778312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:9985:x1875495932177792:12345-0@lo:502: Request processed in 1056us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.778321:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788612448.779033:0:9985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9985:1875495932177792:0@lo:502: 00000020:01000000:2.0:1788612448.779069:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788612448.779077:0:9985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788612448.779084:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612448.779087:0:9985:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788612448.779093:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788612448.779096:0:9985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1788612448.779118:0:9985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788612448.779121:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612448.779137:0:9985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9611c64bcd40) 00000020:00000080:2.0:1788612448.779161:0:9985:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788612448.779166:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788612448.779248:0:9985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788612448.779530:0:9985:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788612448.779600:0:9985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc7f26 00010000:00080000:2.0:1788612448.779631:0:9985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96130168c000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612448.779875:0:9985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788612448.780011:0:9985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788612448.780025:0:9985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788612448.780203:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612448.782982:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612448.783125:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788612448.783212:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788612448.784138:0:9986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612448.784144:0:9986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788612448.787925:0:9985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612448.787940:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788612448.787982:0:9985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788612448.788007:0:9985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7f2d 00000100:00080000:3.0:1788612448.788017:0:9985:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612448.788022:0:9985:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96130168c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612448.788055:0:9985:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fe976d80 x1875495932177920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612448.788119:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932177920:0@lo:8: 00000100:00100000:0.0:1788612448.788184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.788308:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932177920 00000100:00100000:2.0:1788612448.788315:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932177920 00000100:00100000:2.0:1788612448.788346:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612448.788354:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932177920:12345-0@lo:8: 00010000:00080000:2.0:1788612448.788378:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1788612448.788401:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc7f34 00002000:00100000:2.0:1788612448.788413:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff96130066e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788612448.788417:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788612448.788422:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788612448.788505:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788612448.788755:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788612448.788778:0:8439:0:(import.c:65:import_set_state_nolock()) ffff96130066a800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788612448.789036:0:9985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788612448.789161:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932178176:0@lo:400: 00000100:00100000:3.0:1788612448.789196:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.789220:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932178688:0@lo:400: 00000100:00100000:3.0:1788612448.789241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.789256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932179200:0@lo:400: 00000100:00100000:3.0:1788612448.789277:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.789906:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788612448.789916:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932178048:0@lo:400: 00000100:00100000:3.0:1788612448.789943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.789962:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932178560:0@lo:400: 00000100:00100000:3.0:1788612448.789993:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.790009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932179072:0@lo:400: 00000100:00100000:3.0:1788612448.790028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.790049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932178304:0@lo:400: 00000100:00100000:3.0:1788612448.790070:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.790083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932178816:0@lo:400: 00000100:00100000:3.0:1788612448.790105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.790124:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788612448.790129:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932178432:0@lo:400: 00000100:00100000:3.0:1788612448.790163:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.790184:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932178944:0@lo:400: 00000100:00100000:3.0:1788612448.790205:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.790237:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178688 00000100:00100000:3.0:1788612448.790244:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178688 00000100:00100000:1.0:1788612448.791139:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179200 00000100:00100000:1.0:1788612448.791147:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179200 00000100:00100000:3.0:1788612448.791224:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178048 00000100:00100000:3.0:1788612448.791228:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178048 00000100:00100000:1.0:1788612448.791980:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178560 00000100:00100000:1.0:1788612448.791985:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178560 00000100:00100000:1.0:1788612448.792004:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179072 00000100:00100000:1.0:1788612448.792007:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179072 00000100:00100000:1.0:1788612448.792018:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178304 00000100:00100000:1.0:1788612448.792021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178304 00000100:00100000:1.0:1788612448.792037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612448.792047:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932178688:12345-0@lo:400: 00000100:00100000:1.0:1788612448.792127:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932178688:12345-0@lo:400: Request processed in 81us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.792134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612448.792151:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612448.792157:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932179200:12345-0@lo:400: 00000100:00100000:1.0:1788612448.792185:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932179200:12345-0@lo:400: Request processed in 28us (2907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.792191:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612448.792202:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788612448.792208:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932178560:12345-0@lo:400: 00000100:00100000:1.0:1788612448.792250:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932178560:12345-0@lo:400: Request processed in 42us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.792268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612448.792504:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932177920:12345-0@lo:8: Request processed in 4148us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.792513:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612448.792529:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178816 00000100:00100000:2.0:1788612448.792532:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178816 00000100:00100000:2.0:1788612448.792564:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178944 00000100:00100000:2.0:1788612448.792568:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178944 00000100:00100000:2.0:1788612448.792582:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612448.792588:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932178816:12345-0@lo:400: 00000100:00100000:2.0:1788612448.792627:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932178816:12345-0@lo:400: Request processed in 40us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.792633:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612448.792652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612448.792659:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932178944:12345-0@lo:400: 00000100:00100000:2.0:1788612448.792688:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932178944:12345-0@lo:400: Request processed in 29us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.792693:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788612448.792762:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f4e00 x1875495932178944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.792776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932178944:0@lo:400: 00010000:00080000:2.0:1788612448.792788:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f7100 x1875495932178816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.792797:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932178816:0@lo:400: 00000100:00100000:1.0:1788612448.792995:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612448.793008:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932179072:12345-0@lo:400: 00000100:00100000:1.0:1788612448.793043:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932179072:12345-0@lo:400: Request processed in 39us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.793049:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612448.793062:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612448.793068:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932178304:12345-0@lo:400: 00000100:00100000:1.0:1788612448.793108:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932178304:12345-0@lo:400: Request processed in 40us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.793114:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788612448.793153:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f7800 x1875495932178560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.793163:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932178560:0@lo:400: 00010000:00080000:1.0:1788612448.793178:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f4a80 x1875495932179072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.793186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932179072:0@lo:400: 00010000:00080000:1.0:1788612448.793197:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f6680 x1875495932178688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.793205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932178688:0@lo:400: 00010000:00080000:1.0:1788612448.793219:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f4000 x1875495932179200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.793240:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932179200:0@lo:400: 00010000:00080000:2.0:1788612448.793530:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f5f80 x1875495932178304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.793550:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932178304:0@lo:400: 00010000:00080000:0.0:1788612448.793681:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe976d80 x1875495932177920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612448.793691:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612448.793699:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788612448.793706:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788612448.793711:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788612448.793722:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130168c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788612448.793905:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788612448.793913:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932177920:0@lo:8: 00000100:00100000:0.0:1788612448.793939:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178176 00000100:00100000:0.0:1788612448.793944:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178176 00000100:00100000:0.0:1788612448.793971:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932178432 00000100:00100000:0.0:1788612448.793974:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932178432 00000100:00100000:0.0:1788612448.793988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788612448.793994:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932178176:12345-0@lo:400: 00000100:00100000:0.0:1788612448.794046:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932178176:12345-0@lo:400: Request processed in 51us (4849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.794051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788612448.794064:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788612448.794071:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932178432:12345-0@lo:400: 00000100:00100000:0.0:1788612448.794099:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932178432:12345-0@lo:400: Request processed in 30us (3936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.794104:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788612448.794177:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932178432:0@lo:400: 00000004:00080000:2.0:1788612448.794195:0:9986:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788612448.794451:0:9986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 263177974078ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788612448.794459:0:9986:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788612448.794646:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932178176:0@lo:400: 00000100:00100000:1.0:1788612448.794692:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932179328:0@lo:700: 00000100:00100000:1.0:1788612448.794731:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.794832:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.794874:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179328 00000100:00100000:2.0:1788612448.794878:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179328 00000100:00100000:2.0:1788612448.794968:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612448.794977:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9987:x1875495932179328:12345-0@lo:700: 00000100:00100000:2.0:1788612448.795004:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1875495932179456:0@lo:700: 00000100:00100000:2.0:1788612448.795031:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.795064:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03a80 going to sleep for 11 seconds 00000020:01000000:0.0:1788612448.795906:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612448.795914:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612448.795916:0:9985:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788612448.795920:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612448.795925:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612448.795926:0:9985:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788612448.795929:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788612448.795931:0:9985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788612448.795959:0:9985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9985:1875495932179584:0@lo:502: 00000100:00100000:0.0:1788612448.796014:0:9985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612448.796048:0:9985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d8afe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612448.796111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179584 00000100:00100000:2.0:1788612448.796117:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179584 00000100:00100000:2.0:1788612448.796158:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612448.796166:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:9985:x1875495932179584:12345-0@lo:502: 00000100:00100000:2.0:1788612448.796506:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:9985:x1875495932179584:12345-0@lo:502: Request processed in 339us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.796513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788612448.796920:0:9985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9985:1875495932179584:0@lo:502: 00000020:01000000:0.0:1788612448.796955:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612448.796961:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612448.796963:0:9985:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788612448.796967:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1788612448.797152:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179456 00000100:00100000:3.0:1788612448.797156:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179456 00000100:00100000:3.0:1788612448.797183:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612448.797190:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1875495932179456:12345-0@lo:700: 00000100:00080000:3.0:1788612448.797312:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612448.797316:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612448.797319:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612448.797322:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000000:3.0:1788612448.797333:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788612448.797353:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788612448.797363:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797385:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612448.797395:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788612448.797397:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612c7237000 from 39 10000000:01000000:3.0:1788612448.797401:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612448.797426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797445:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797454:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.797469:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932179712:0@lo:101: 00000100:00100000:3.0:1788612448.797533:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.797573:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.797586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179712 00000100:00100000:3.0:1788612448.797589:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179712 00000100:00100000:3.0:1788612448.797615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788612448.797621:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932179712:12345-0@lo:101: 00010000:00010000:3.0:1788612448.797629:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612448.797654:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7f3b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797676:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797696:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797704:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2400, rc 0) 00000100:00100000:3.0:1788612448.797749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932179712:12345-0@lo:101: Request processed in 115us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.797755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788612448.797787:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932179712:0@lo:101: 00010000:00010000:3.0:1788612448.797799:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.797807:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.797855:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932179840:0@lo:501: 00000100:00100000:3.0:1788612448.797877:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.797891:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.797904:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179840 00000100:00100000:3.0:1788612448.797907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179840 00000100:00100000:3.0:1788612448.797928:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612448.797934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932179840:12345-0@lo:501: 00000100:00100000:3.0:1788612448.798020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932179840:12345-0@lo:501: Request processed in 86us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.798027:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612448.798053:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932179840:0@lo:501: 00000100:00100000:3.0:1788612448.798074:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932179968:0@lo:503: 00000100:00100000:3.0:1788612448.798110:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.798121:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.798130:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932179968 00000100:00100000:3.0:1788612448.798133:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932179968 00000100:00100000:3.0:1788612448.798148:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788612448.798152:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932179968:12345-0@lo:503: 00000100:00100000:3.0:1788612448.798212:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932179968:12345-0@lo:503: Request processed in 59us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.798219:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788612448.798256:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932179968:0@lo:503: 00000100:00100000:3.0:1788612448.798389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612448.798398:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932178048:12345-0@lo:400: 00000100:00100000:3.0:1788612448.798449:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932178048:12345-0@lo:400: Request processed in 53us (8505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.798455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612448.798564:0:9988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9988:1875495932180096:0@lo:502: 00000100:00100000:3.0:1788612448.798597:0:9988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.798614:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180096 00000100:00100000:3.0:1788612448.798617:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180096 00000100:00100000:3.0:1788612448.798636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788612448.798642:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:9988:x1875495932180096:12345-0@lo:502: 00000100:00100000:3.0:1788612448.798705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:9988:x1875495932180096:12345-0@lo:502: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.798712:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788612448.798741:0:9988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.798754:0:9988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9988:1875495932180096:0@lo:502: 00000100:00100000:3.0:1788612448.798794:0:9988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9988:1875495932180224:0@lo:502: 00000100:00100000:3.0:1788612448.798824:0:9988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.798842:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180224 00000100:00100000:3.0:1788612448.798845:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180224 00000100:00100000:3.0:1788612448.798864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788612448.798870:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:9988:x1875495932180224:12345-0@lo:502: 00000100:00100000:3.0:1788612448.798927:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:9988:x1875495932180224:12345-0@lo:502: Request processed in 56us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.798933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788612448.798959:0:9988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.798970:0:9988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9988:1875495932180224:0@lo:502: 00000040:00080000:3.0:1788612448.798988:0:9988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788612448.799026:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788612448.799040:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612448.799046:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799055:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612448.799062:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612448.799063:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c7237000 from 6 10000000:01000000:3.0:1788612448.799066:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612448.799082:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799089:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799106:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.799116:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180352:0@lo:101: 00000100:00100000:3.0:1788612448.799137:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.799147:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.799157:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180352 00000100:00100000:3.0:1788612448.799161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180352 00000100:00100000:3.0:1788612448.799178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788612448.799183:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932180352:12345-0@lo:101: 00010000:00010000:3.0:1788612448.799188:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612448.799197:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2e00/0x1f8616bf0bc7f50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7f49 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799211:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2e00/0x1f8616bf0bc7f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f49 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799220:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2e00/0x1f8616bf0bc7f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f49 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799227:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2e00, rc 0) 00000100:00100000:3.0:1788612448.799253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932180352:12345-0@lo:101: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.799258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788612448.799284:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180352:0@lo:101: 00010000:00010000:3.0:1788612448.799294:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799311:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.799348:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180480:0@lo:256: 00000100:00100000:3.0:1788612448.799374:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.799386:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.799395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180480 00000100:00100000:3.0:1788612448.799398:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180480 00000100:00100000:3.0:1788612448.799417:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788612448.799423:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932180480:12345-0@lo:256: 20000000:01000000:3.0:1788612448.799448:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612448.799464:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612448.799467:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788612448.799555:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932180480:12345-0@lo:256: Request processed in 131us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.799561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788612448.799588:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180480:0@lo:256: 10000000:01000000:3.0:1788612448.799622:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612448.799627:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799635:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612448.799641:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788612448.799642:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788612448.799644:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788612448.799660:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799667:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799674:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.799683:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180608:0@lo:101: 00000100:00100000:3.0:1788612448.799703:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.799719:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.799732:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180608 00000100:00100000:3.0:1788612448.799735:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180608 00000100:00100000:3.0:1788612448.799753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788612448.799758:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932180608:12345-0@lo:101: 00010000:00010000:3.0:1788612448.799763:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612448.799771:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7f57 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799783:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799790:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799797:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3000, rc 0) 00000100:00100000:3.0:1788612448.799817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932180608:12345-0@lo:101: Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.799823:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788612448.799851:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180608:0@lo:101: 00010000:00010000:3.0:1788612448.799860:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.799868:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612448.799906:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180736:0@lo:501: 00000100:00100000:3.0:1788612448.799929:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.799949:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.799958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180736 00000100:00100000:3.0:1788612448.799961:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180736 00000100:00100000:3.0:1788612448.799978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788612448.799982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932180736:12345-0@lo:501: 00000100:00100000:3.0:1788612448.800052:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932180736:12345-0@lo:501: Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.800058:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788612448.800086:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180736:0@lo:501: 00000100:00100000:3.0:1788612448.800104:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180864:0@lo:503: 00000100:00100000:3.0:1788612448.800133:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.800143:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.800151:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180864 00000100:00100000:3.0:1788612448.800154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180864 00000100:00100000:3.0:1788612448.800170:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788612448.800175:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932180864:12345-0@lo:503: 00000100:00100000:3.0:1788612448.800235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932180864:12345-0@lo:503: Request processed in 59us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.800249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788612448.800284:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932180864:0@lo:503: 00000100:00100000:2.0:1788612448.801156:0:9989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9989:1875495932180992:0@lo:502: 00000100:00100000:2.0:1788612448.801200:0:9989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.801231:0:9989:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.801293:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932180992 00000100:00100000:0.0:1788612448.801299:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932180992 00000100:00100000:0.0:1788612448.801339:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788612448.801346:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:9989:x1875495932180992:12345-0@lo:502: 00000100:00100000:0.0:1788612448.801438:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:9989:x1875495932180992:12345-0@lo:502: Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.801446:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:0.0:1788612448.801531:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f6300 x1875495932178048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.801706:0:9989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9989:1875495932180992:0@lo:502: 00000020:01000000:2.0:1788612448.801732:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788612448.801749:0:9989:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788612448.801756:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612448.801759:0:9989:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788612448.801765:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788612448.801769:0:9989:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1788612448.801791:0:9989:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788612448.801794:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612448.801816:0:9989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9611c5a20000) 00000020:00000080:2.0:1788612448.801836:0:9989:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788612448.801844:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788612448.801922:0:9989:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788612448.801928:0:9989:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788612448.801934:0:9989:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc7f6c 00010000:00080000:2.0:1788612448.801963:0:9989:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c78b4000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612448.802182:0:9989:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788612448.802328:0:9989:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788612448.802345:0:9989:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788612448.802532:0:9989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612448.802667:0:9989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612448.802792:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788612448.802903:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:1.0:1788612448.802913:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788612448.803454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932178048:0@lo:400: 00000040:00080000:0.0:1788612448.804073:0:9990:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612448.804077:0:9990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 40000000:02000000:0.0:1788612448.806338:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:00000080:3.0:1788612448.810638:0:9989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612448.810655:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788612448.810701:0:9989:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788612448.810728:0:9989:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7f73 00000100:00080000:3.0:1788612448.810739:0:9989:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612448.810899:0:9989:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9611c78b4000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612448.810933:0:9989:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7880380 x1875495932181120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612448.810958:0:9989:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788612448.811003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932181120:0@lo:8: 00000100:00100000:1.0:1788612448.811090:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788612448.811095:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612448.811102:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612448.811104:0:9989:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788612448.811107:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612448.811112:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612448.811113:0:9989:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788612448.811117:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788612448.811119:0:9989:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788612448.811133:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181120 00000100:00100000:1.0:1788612448.811141:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181120 00000100:00100000:3.0:1788612448.811146:0:9989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9989:1875495932181248:0@lo:502: 00000100:00100000:1.0:1788612448.811176:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612448.811185:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932181120:12345-0@lo:8: 00000100:00100000:3.0:1788612448.811201:0:9989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612448.811213:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000100:00100000:3.0:1788612448.811239:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181248 00000100:00100000:3.0:1788612448.811244:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181248 00000020:00000080:1.0:1788612448.811252:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc7f7a 00002000:00100000:1.0:1788612448.811266:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9611c68fd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788612448.811271:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788612448.811273:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788612448.811335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00002000:00080000:1.0:1788612448.811346:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788612448.811347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:9989:x1875495932181248:12345-0@lo:502: 00000100:00080000:1.0:1788612448.811371:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9611c68f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612448.811417:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932181120:12345-0@lo:8: Request processed in 232us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.811424:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612448.811501:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:9989:x1875495932181248:12345-0@lo:502: Request processed in 131us (273us total) trans 0 rc 0/0 00010000:00080000:1.0:1788612448.811512:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880380 x1875495932181120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612448.811523:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788612448.811530:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612448.811545:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788612448.811552:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788612448.811557:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788612448.811560:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c78b4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788612448.811573:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788612448.811579:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932181120:0@lo:8: 00000100:00100000:3.0:1788612448.811739:0:9989:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.811865:0:9989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:9989:1875495932181248:0@lo:502: 00000020:01000000:3.0:1788612448.811887:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612448.811892:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612448.811894:0:9989:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788612448.811897:0:9989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788612448.814694:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788612448.814748:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788612448.814761:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.814773:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612448.814783:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788612448.814786:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9612d1e64d40 from 1 10000000:01000000:1.0:1788612448.814789:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788612448.814830:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.814838:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.814849:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612448.814873:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932181376:0@lo:101: 00000100:00100000:1.0:1788612448.814944:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.814984:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612448.815014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181376 00000100:00100000:1.0:1788612448.815021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181376 00000100:00100000:1.0:1788612448.815078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788612448.815087:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932181376:12345-0@lo:101: 00010000:00010000:1.0:1788612448.815099:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612448.815111:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7f81 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.815133:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.815144:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612448.815153:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4400, rc 0) 00000100:00100000:1.0:1788612448.815200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932181376:12345-0@lo:101: Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.815207:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788612448.815279:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932181376:0@lo:101: 00010000:00010000:2.0:1788612448.815300:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612448.815310:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612448.815380:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932181504:0@lo:501: 00000100:00100000:2.0:1788612448.815408:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.815498:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612448.815691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181504 00000100:00100000:3.0:1788612448.815696:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181504 00000100:00100000:3.0:1788612448.815730:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788612448.815737:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932181504:12345-0@lo:501: 00000100:00100000:3.0:1788612448.815819:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932181504:12345-0@lo:501: Request processed in 82us (410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612448.815826:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788612448.815855:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932181504:0@lo:501: 10000000:01000000:3.0:1788612448.815882:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788612448.815889:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612448.815898:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612448.818777:0:9991:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788612448.818811:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932181760:0@lo:7: 00000100:00100000:2.0:1788612448.818875:0:9991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.818905:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612448.818992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932181632:0@lo:13: 00000100:00100000:1.0:1788612448.819024:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.819158:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181632 00000100:00100000:2.0:1788612448.819165:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181632 00000100:00100000:2.0:1788612448.819227:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612448.819236:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932181632:12345-0@lo:13: 00002000:00000024:2.0:1788612448.819262:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788612448.819306:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932181632:12345-0@lo:13: Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612448.819315:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788612448.819377:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788612448.819407:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864700 x1875495932181632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.819441:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932181632:0@lo:13: 00000100:00100000:1.0:1788612448.820409:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1875495932179456:12345-0@lo:700: Request processed in 23216us (25373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.820419:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:1.0:1788612448.820460:0:9990:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788612448.820572:0:9990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 263204094766ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788612448.820579:0:9990:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788612448.821373:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181760 00000100:00100000:0.0:1788612448.821381:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181760 00000100:00100000:0.0:1788612448.821442:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612448.821452:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9991:x1875495932181760:12345-0@lo:7: 00010000:00080000:2.0:1788612448.821591:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7865880 x1875495932179456/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.821615:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1875495932179456:0@lo:700: 40000000:02000000:2.0:1788612448.821628:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:3.0:1788612448.828520:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788612448.829799:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788612448.829808:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788612448.829956:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9991:x1875495932181760:12345-0@lo:7: Request processed in 8502us (11077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.829967:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788612448.830415:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7867480 x1875495932181760/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.830443:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932181760:0@lo:7: 00000004:00080000:1.0:1788612448.830461:0:9991:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788612448.830531:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932181888:0@lo:5: 00000100:00100000:1.0:1788612448.830577:0:9991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.830620:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932181888 00000100:00100000:1.0:1788612448.830626:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932181888 00000100:00100000:1.0:1788612448.830672:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612448.830683:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9991:x1875495932181888:12345-0@lo:5: 00002000:00080000:1.0:1788612448.830707:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788612448.830711:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788612448.831002:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3dc00 going to sleep for 11 seconds 00000001:00080000:1.0:1788612448.839063:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788612448.839083:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788612448.839088:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788612448.839353:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9991:x1875495932181888:12345-0@lo:5: Request processed in 8668us (8773us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788612448.839365:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788612448.839471:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed3100 x1875495932181888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.839545:0:9991:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788612448.839552:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932181888:0@lo:5: 00000004:00080000:1.0:1788612448.839566:0:9991:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788612448.839612:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932182016:0@lo:700: 00000100:00100000:1.0:1788612448.839668:0:9991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.839737:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.844385:0:8448:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:1.0:1788612448.844525:0:8448:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1788612448.844752:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182016 00000100:00100000:3.0:1788612448.844765:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182016 00000100:00100000:1.0:1788612448.844861:0:9992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612448.844873:0:9992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9991:x1875495932182016:12345-0@lo:700: 00000100:00100000:3.0:1788612448.862165:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9987:x1875495932179328:12345-0@lo:700: Request processed in 67178us (67422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612448.862200:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788612448.862347:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0a80 x1875495932179328/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612448.862362:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932179328:0@lo:700: 00000004:00080000:1.0:1788612448.870571:0:9987:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788612448.870605:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932182272:0@lo:7: 00000100:00100000:1.0:1788612448.870670:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.870723:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612448.870745:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182272 00000100:00100000:1.0:1788612448.870752:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182272 00000100:00100000:1.0:1788612448.870800:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612448.870810:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9987:x1875495932182272:12345-0@lo:7: 00000100:00100000:0.0:1788612448.870946:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612448.870961:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932182144:0@lo:13: 00000100:00100000:0.0:1788612448.871003:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612448.871040:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182144 00000100:00100000:0.0:1788612448.871045:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182144 00000100:00100000:0.0:1788612448.871079:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612448.871087:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932182144:12345-0@lo:13: 00002000:00000024:0.0:1788612448.871103:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788612448.871153:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932182144:12345-0@lo:13: Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.871161:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788612448.871208:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76eb800 x1875495932182144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612448.871231:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932182144:0@lo:13: 00000100:00100000:0.0:1788612448.876128:0:9992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9991:x1875495932182016:12345-0@lo:700: Request processed in 31251us (36453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.876144:0:9992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788612448.879384:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed3100 x1875495932182016/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.879403:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932182016:0@lo:700: 00002000:00080000:1.0:1788612448.885565:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788612448.885577:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788612448.885678:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9987:x1875495932182272:12345-0@lo:7: Request processed in 14865us (15004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.885689:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788612448.885747:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ea680 x1875495932182272/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.885764:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932182272:0@lo:7: 00000004:00080000:2.0:1788612448.885778:0:9987:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788612448.885831:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932182400:0@lo:5: 00000100:00100000:2.0:1788612448.885869:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.885901:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612448.886108:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182400 00000100:00100000:1.0:1788612448.886116:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182400 00000004:02000040:3.0:1788612448.886134:0:9991:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788612448.886165:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612448.886175:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9987:x1875495932182400:12345-0@lo:5: 00002000:00080000:1.0:1788612448.886224:0:8543:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788612448.886272:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9987:x1875495932182400:12345-0@lo:5: Request processed in 98us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.886279:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788612448.886943:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7865880 x1875495932182400/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612448.886956:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932182400:0@lo:5: 00000004:00080000:0.0:1788612448.886967:0:9987:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788612448.887003:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932182528:0@lo:5: 00000100:00100000:0.0:1788612448.887039:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612448.887066:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612448.887325:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182528 00000100:00100000:1.0:1788612448.887331:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182528 00000100:00100000:1.0:1788612448.887378:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612448.887387:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9987:x1875495932182528:12345-0@lo:5: 00002000:00080000:1.0:1788612448.887420:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788612448.892290:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9987:x1875495932182528:12345-0@lo:5: Request processed in 4898us (5244us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788612448.892313:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788612448.892529:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692f800 x1875495932182528/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.892548:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875495932182528:0@lo:5: 00000004:00080000:2.0:1788612448.892563:0:9987:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788612448.892602:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7866300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9987:1875495932182656:0@lo:900: 00000100:00100000:2.0:1788612448.892638:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612448.892667:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.892771:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182656 00000100:00100000:0.0:1788612448.892778:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182656 00000100:00100000:0.0:1788612448.892886:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612448.892896:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9987:x1875495932182656:12345-0@lo:900: 00000100:00100000:0.0:1788612448.892999:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9987:x1875495932182656:12345-0@lo:900: Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612448.893006:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612448.894965:0:9991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932182784:0@lo:5: 00000100:00100000:3.0:1788612448.895027:0:9991:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612448.895110:0:9991:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612448.899123:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182784 00000100:00100000:0.0:1788612448.899135:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182784 00000100:00100000:0.0:1788612448.899236:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612448.899246:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9991:x1875495932182784:12345-0@lo:5: 00010000:00080000:2.0:1788612448.903514:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7866300 x1875495932182656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.904196:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7866300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9987:1875495932182656:0@lo:900: 00002000:00080000:0.0:1788612448.909303:0:8543:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788612448.909325:0:8543:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788612448.917732:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9991:x1875495932182784:12345-0@lo:5: Request processed in 18480us (22697us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788612448.917746:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788612448.918530:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7881f80 x1875495932182784/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612448.918559:0:9991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875495932182784:0@lo:5: 00000004:00080000:3.0:1788612448.918573:0:9991:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1788612449.117070:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788612449.117091:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788612449.263733:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932182912:0@lo:41: 00000100:00100000:1.0:1788612449.263820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612449.263985:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932182912 00000100:00100000:0.0:1788612449.263992:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932182912 00000100:00100000:0.0:1788612449.264047:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788612449.264058:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932182912:12345-0@lo:41: 00000004:00000024:0.0:1788612449.264090:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612449.264139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932182912:12345-0@lo:41: Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612449.264146:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788612449.264353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932182912:0@lo:41: 00000100:00100000:1.0:1788612449.264799:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612449.264810:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932183040:0@lo:13: 00000100:00100000:1.0:1788612449.264847:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612449.264887:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183040 00000100:00100000:1.0:1788612449.264891:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183040 00000100:00100000:1.0:1788612449.264925:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612449.264933:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932183040:12345-0@lo:13: 00002000:00000024:1.0:1788612449.264968:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612449.265009:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932183040:12345-0@lo:13: Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612449.265016:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788612449.265050:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e8e00 x1875495932183040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612449.265064:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932183040:0@lo:13: 00000100:00100000:0.0:1788612449.265549:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932183168:0@lo:13: 00000100:00100000:0.0:1788612449.265612:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612449.265753:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183168 00000100:00100000:2.0:1788612449.265758:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183168 00000100:00100000:2.0:1788612449.265802:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612449.265810:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932183168:12345-0@lo:13: 00002000:00000024:2.0:1788612449.265822:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612449.265857:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932183168:12345-0@lo:13: Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612449.265862:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788612449.265890:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7866300 x1875495932183168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612449.265904:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932183168:0@lo:13: 00010000:00010000:1.0:1788612449.648291:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788612450.091931:0:10042:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612450.093333:0:10042:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788612450.676362:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788612450.911946:0:10090:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612450.911958:0:10090:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788612451.461963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.462061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914307712 00000100:00100000:2.0:1788612451.462070:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914307712 00000100:00100000:2.0:1788612451.462117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:2.0:1788612451.462125:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1875495914307712:12345-192.168.203.30@tcp:250: 00010000:00080000:2.0:1788612451.462152:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a4a7b63b-1ca3-448d-b4ff-632109d126dc@192.168.203.30@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1788612451.462178:0:6518:0:(genops.c:1385:class_connect()) connect: client a4a7b63b-1ca3-448d-b4ff-632109d126dc, cookie 0x1f8616bf0bc7f8f 00000100:00080000:2.0:1788612451.462321:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9611c7936800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612451.462386:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+5:2393:x1875495914307712:12345-192.168.203.30@tcp:250: Request processed in 259us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612451.462394:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:2.0:1788612451.466732:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612451.466867:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914307840 00000100:00100000:1.0:1788612451.466876:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914307840 00000100:00100000:1.0:1788612451.466929:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:1.0:1788612451.466945:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+5:6152:x1875495914307840:12345-192.168.203.30@tcp:101: 00010000:00010000:1.0:1788612451.466962:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612451.466981:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d21fd6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612451.467007:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612451.467019:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612451.467029:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4e00, rc 0) 00000100:00100000:1.0:1788612451.467083:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+6:6152:x1875495914307840:12345-192.168.203.30@tcp:101: Request processed in 140us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612451.467091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:1.0:1788612451.471768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612451.471905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914307968 00000100:00100000:0.0:1788612451.471915:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914307968 00000100:00100000:0.0:1788612451.471976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:0.0:1788612451.471986:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+6:6152:x1875495914307968:12345-192.168.203.30@tcp:501: 00000100:00100000:0.0:1788612451.472119:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+6:6152:x1875495914307968:12345-192.168.203.30@tcp:501: Request processed in 133us (359us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612451.472127:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:0.0:1788612451.475721:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.477281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308096 00000100:00100000:2.0:1788612451.477296:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308096 00000100:00100000:2.0:1788612451.477386:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:2.0:1788612451.477397:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+6:6152:x1875495914308096:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1788612451.477422:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612451.477443:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d21fdd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612451.477518:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612451.477530:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612451.477540:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1600, rc 0) 00000100:00100000:2.0:1788612451.477605:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+7:6152:x1875495914308096:12345-192.168.203.30@tcp:101: Request processed in 210us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612451.477611:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:3.0:1788612451.480829:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.480974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308224 00000100:00100000:2.0:1788612451.480982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308224 00000100:00100000:2.0:1788612451.481036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:2.0:1788612451.481047:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+7:6152:x1875495914308224:12345-192.168.203.30@tcp:501: 00000100:00100000:2.0:1788612451.481202:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6152:x1875495914308224:12345-192.168.203.30@tcp:501: Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612451.481209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:1.0:1788612451.486786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.489203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308352 00000100:00100000:2.0:1788612451.489217:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308352 00000100:00100000:2.0:1788612451.489347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:2.0:1788612451.489358:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6152:x1875495914308352:12345-192.168.203.30@tcp:503: 00000100:00100000:2.0:1788612451.489687:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6152:x1875495914308352:12345-192.168.203.30@tcp:503: Request processed in 330us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612451.489695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1788612451.493076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612451.493194:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308480 00000100:00100000:3.0:1788612451.493203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308480 00000100:00100000:3.0:1788612451.493270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:3.0:1788612451.493280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6171:x1875495914308480:12345-192.168.203.30@tcp:502: 00000100:00100000:3.0:1788612451.493439:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6171:x1875495914308480:12345-192.168.203.30@tcp:502: Request processed in 160us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612451.493447:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:3.0:1788612451.529898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.529988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308608 00000100:00100000:2.0:1788612451.529996:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308608 00000100:00100000:2.0:1788612451.530052:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:2.0:1788612451.530061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6171:x1875495914308608:12345-192.168.203.30@tcp:502: 00000100:00100000:2.0:1788612451.530431:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6171:x1875495914308608:12345-192.168.203.30@tcp:502: Request processed in 369us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612451.530441:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:1.0:1788612451.534427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612451.534520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308736 00000100:00100000:0.0:1788612451.534530:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308736 00000100:00100000:0.0:1788612451.534693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:0.0:1788612451.534704:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6152:x1875495914308736:12345-192.168.203.30@tcp:101: 00010000:00010000:0.0:1788612451.534723:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612451.534752:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe924000/0x1f8616bf0bc7fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2200e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612451.534778:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe924000/0x1f8616bf0bc7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2200e expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612451.534789:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe924000/0x1f8616bf0bc7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2200e expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612451.534798:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924000, rc 0) 00000100:00100000:0.0:1788612451.534870:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6152:x1875495914308736:12345-192.168.203.30@tcp:101: Request processed in 168us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612451.534889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:1.0:1788612451.542660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.542919:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308864 00000100:00100000:2.0:1788612451.542928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308864 00000100:00100000:2.0:1788612451.542983:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:2.0:1788612451.542993:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6152:x1875495914308864:12345-192.168.203.30@tcp:256: 20000000:01000000:2.0:1788612451.543017:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788612451.543047:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788612451.543051:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788612451.543055:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788612451.543057:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788612451.543059:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788612451.547183:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6152:x1875495914308864:12345-192.168.203.30@tcp:256: Request processed in 4179us (4520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612451.547200:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:1.0:1788612451.557328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612451.557438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308992 00000100:00100000:0.0:1788612451.557449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308992 00000100:00100000:0.0:1788612451.557535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:0.0:1788612451.557545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6152:x1875495914308992:12345-192.168.203.30@tcp:101: 00010000:00010000:0.0:1788612451.557560:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612451.557577:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22015 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612451.557606:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612451.557617:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612451.557627:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe925000, rc 0) 00000100:00100000:0.0:1788612451.557799:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6152:x1875495914308992:12345-192.168.203.30@tcp:101: Request processed in 254us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612451.557806:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:0.0:1788612451.560206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612451.560869:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309120 00000100:00100000:1.0:1788612451.560879:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309120 00000100:00100000:1.0:1788612451.560963:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:1.0:1788612451.560973:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6152:x1875495914309120:12345-192.168.203.30@tcp:501: 00000100:00100000:1.0:1788612451.561151:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6152:x1875495914309120:12345-192.168.203.30@tcp:501: Request processed in 179us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612451.561160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:2.0:1788612451.563003:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612451.563305:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309248 00000100:00100000:3.0:1788612451.563315:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309248 00000100:00100000:3.0:1788612451.563367:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:3.0:1788612451.563377:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6152:x1875495914309248:12345-192.168.203.30@tcp:503: 00000100:00100000:3.0:1788612451.563554:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6152:x1875495914309248:12345-192.168.203.30@tcp:503: Request processed in 179us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612451.563569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:2.0:1788612451.568948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612451.569102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309376 00000100:00100000:1.0:1788612451.569113:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309376 00000100:00100000:1.0:1788612451.569220:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1788612451.569232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6176:x1875495914309376:12345-192.168.203.30@tcp:502: 00000100:00100000:1.0:1788612451.569410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6176:x1875495914309376:12345-192.168.203.30@tcp:502: Request processed in 179us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612451.569427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1788612451.577250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612451.577724:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309504 00000100:00100000:0.0:1788612451.577735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309504 00000100:00100000:0.0:1788612451.577850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:0.0:1788612451.577861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6176:x1875495914309504:12345-192.168.203.30@tcp:502: 00000100:00100000:0.0:1788612451.578029:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6176:x1875495914309504:12345-192.168.203.30@tcp:502: Request processed in 168us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612451.578036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:2.0:1788612451.585398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612451.585446:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612451.585688:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309632 00000100:00100000:0.0:1788612451.585699:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309632 00000100:00100000:0.0:1788612451.585740:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309888 00000100:00100000:0.0:1788612451.585744:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309888 00000100:00100000:0.0:1788612451.585770:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788612451.585779:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875495914309632:12345-192.168.203.30@tcp:38: 00010000:00080000:0.0:1788612451.585821:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1788612451.585871:0:6523:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc7fb2 00000004:00100000:0.0:1788612451.585895:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788612451.586110:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9611c6b35800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612451.586169:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914309632:12345-192.168.203.30@tcp:38: Request processed in 389us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612451.586176:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788612451.586194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1788612451.586200:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875495914309888:12345-192.168.203.30@tcp:38: 00010000:00080000:0.0:1788612451.586214:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1788612451.586252:0:6523:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc7fb9 00000004:00100000:0.0:1788612451.586264:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788612451.586390:0:6523:0:(import.c:65:import_set_state_nolock()) ffff961301689800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612451.586425:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914309888:12345-192.168.203.30@tcp:38: Request processed in 213us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612451.586432:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00010000:00010000:1.0:1788612451.695649:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612452.335770:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932183296:0@lo:41: 00000100:00100000:1.0:1788612452.335845:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612452.336036:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183296 00000100:00100000:0.0:1788612452.336044:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183296 00000100:00100000:0.0:1788612452.336095:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612452.336105:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932183296:12345-0@lo:41: 00000004:00000024:0.0:1788612452.336167:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788612452.336230:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932183296:12345-0@lo:41: Request processed in 127us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.336237:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612452.336322:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932183296:0@lo:41: 00000100:00100000:2.0:1788612452.342984:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612452.343079:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612452.343279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612452.343690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310016 00000100:00100000:0.0:1788612452.343700:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310016 00000100:00100000:0.0:1788612452.343758:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309760 00000100:00100000:0.0:1788612452.343762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309760 00000100:00100000:0.0:1788612452.343790:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788612452.343799:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914310016:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1788612452.343833:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612452.343895:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914310016:12345-192.168.203.30@tcp:41: Request processed in 97us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.343903:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788612452.343922:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788612452.343930:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914309760:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1788612452.343942:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788612452.343967:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914309760:12345-192.168.203.30@tcp:41: Request processed in 38us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.343974:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00080000:3.0:1788612452.344071:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612452.344076:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612452.345035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310144 00000100:00100000:0.0:1788612452.345054:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310144 00000100:00100000:0.0:1788612452.345097:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1788612452.345106:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310144:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1788612452.345124:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788612452.345338:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310144:12345-192.168.203.30@tcp:41: Request processed in 225us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.345355:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1788612452.347740:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612452.347886:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310272 00000100:00100000:0.0:1788612452.347895:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310272 00000100:00100000:0.0:1788612452.347951:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1788612452.347961:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310272:12345-192.168.203.30@tcp:40: 00000100:00100000:0.0:1788612452.348111:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310272:12345-192.168.203.30@tcp:40: Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.348122:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788612452.351569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612452.351611:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612452.351640:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612452.351691:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612452.351851:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310400 00000100:00100000:2.0:1788612452.351860:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310400 00000100:00100000:2.0:1788612452.351905:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310528 00000100:00100000:2.0:1788612452.351909:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310528 00000100:00100000:2.0:1788612452.351927:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1788612452.351935:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875495914310400:12345-192.168.203.30@tcp:8: 00010000:00080000:2.0:1788612452.351971:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1788612452.352003:0:8439:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc7fc0 00002000:00100000:2.0:1788612452.352016:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e1800c7e-b9d8-4080-b6d8-c71cdf3d497c/ffff9611c7930800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788612452.352033:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:0.0:1788612452.352197:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310784 00000100:00100000:0.0:1788612452.352201:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310784 00000100:00100000:0.0:1788612452.352305:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612452.352314:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310784:12345-192.168.203.30@tcp:900: 00000100:00100000:0.0:1788612452.352392:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310784:12345-192.168.203.30@tcp:900: Request processed in 79us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.352400:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612452.352438:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1788612452.352443:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875495914310528:12345-192.168.203.30@tcp:8: 00010000:00080000:0.0:1788612452.352459:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1788612452.352510:0:8441:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc7fc7 00002000:00100000:0.0:1788612452.352517:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e1800c7e-b9d8-4080-b6d8-c71cdf3d497c/ffff961301688800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788612452.352528:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788612452.352702:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788612452.352732:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961300763800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612452.352761:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914310528:12345-192.168.203.30@tcp:8: Request processed in 316us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.352774:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612452.353917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310656 00000100:00100000:1.0:1788612452.353926:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310656 00000100:00100000:1.0:1788612452.353973:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:1.0:1788612452.353980:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914310656:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1788612452.354029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914310656:12345-192.168.203.30@tcp:400: Request processed in 49us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612452.354036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 196 00002000:00080000:2.0:1788612452.355038:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788612452.356535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00080000:2.0:1788612452.356621:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9611c7932000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612452.356689:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914310400:12345-192.168.203.30@tcp:8: Request processed in 4753us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.356701:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1788612452.357002:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310912 00000100:00100000:3.0:1788612452.357010:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310912 00000100:00100000:3.0:1788612452.357125:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788612452.357136:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310912:12345-192.168.203.30@tcp:33: 00000004:00080000:3.0:1788612452.377157:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19946us 00000004:00200000:2.0:1788612452.403560:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788612452.403690:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6152:x1875495914310912:12345-192.168.203.30@tcp:33: Request processed in 46551us (47156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.403706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788612452.549445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612452.549582:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311040 00000100:00100000:0.0:1788612452.549593:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311040 00000100:00100000:0.0:1788612452.549655:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1788612452.549665:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6194:x1875495914311040:12345-192.168.203.30@tcp:101: 00010000:00010000:0.0:1788612452.549683:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612452.549731:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924400/0x1f8616bf0bc7fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22046 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612452.549795:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc7fd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612452.549809:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc7fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612452.549824:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc7fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612452.549869:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612452.549873:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612452.549887:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc7fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612452.549912:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924400/0x1f8616bf0bc7fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22046 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612452.549930:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc7fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22046 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612452.549958:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7f00) 00010000:00010000:0.0:1788612452.549961:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612452.549964:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924e00, rc 0) 00000100:00100000:0.0:1788612452.550021:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:6194:x1875495914311040:12345-192.168.203.30@tcp:101: Request processed in 358us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612452.550028:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:1.0:1788612452.722221:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612453.743626:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612453.871771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932183424:0@lo:13: 00000100:00100000:1.0:1788612453.871857:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612453.872091:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183424 00000100:00100000:2.0:1788612453.872108:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183424 00000100:00100000:2.0:1788612453.872168:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612453.872178:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932183424:12345-0@lo:13: 00002000:00000024:2.0:1788612453.872205:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612453.872249:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932183424:12345-0@lo:13: Request processed in 73us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612453.872256:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788612453.872325:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612453.872560:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932183552:0@lo:13: 00000100:00100000:0.0:1788612453.872594:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612453.872782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932184064:0@lo:400: 00000100:00100000:1.0:1788612453.872812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612453.872833:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932184576:0@lo:400: 00000100:00100000:1.0:1788612453.872869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873168:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932183680:0@lo:400: 00000100:00100000:3.0:1788612453.873202:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873226:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932184192:0@lo:400: 00000100:00100000:3.0:1788612453.873249:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932184704:0@lo:400: 00000100:00100000:3.0:1788612453.873289:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873306:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788612453.873312:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932183808:0@lo:400: 00000100:00100000:3.0:1788612453.873332:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873349:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932184320:0@lo:400: 00000100:00100000:3.0:1788612453.873376:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873389:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932184832:0@lo:400: 00000100:00100000:3.0:1788612453.873422:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.873449:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184064 00000100:00100000:3.0:1788612453.873455:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184064 00000100:00100000:3.0:1788612453.873511:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183808 00000100:00100000:3.0:1788612453.873515:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183808 00000100:00100000:3.0:1788612453.873528:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184320 00000100:00100000:3.0:1788612453.873531:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184320 00000100:00100000:3.0:1788612453.873548:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184832 00000100:00100000:3.0:1788612453.873551:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184832 00000100:00100000:3.0:1788612453.873566:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612453.873573:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932184064:12345-0@lo:400: 00000100:00100000:3.0:1788612453.873612:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932184064:12345-0@lo:400: Request processed in 40us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.873620:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612453.873634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612453.873641:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932183808:12345-0@lo:400: 00000100:00100000:3.0:1788612453.873671:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932183808:12345-0@lo:400: Request processed in 31us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.873677:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612453.873687:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612453.873692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932184320:12345-0@lo:400: 00000100:00100000:3.0:1788612453.873719:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932184320:12345-0@lo:400: Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.873724:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612453.873734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612453.873740:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932184832:12345-0@lo:400: 00000100:00100000:3.0:1788612453.873781:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932184832:12345-0@lo:400: Request processed in 41us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.873787:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788612453.873803:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612453.873813:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184192 00000100:00100000:3.0:1788612453.873816:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184192 00000100:00100000:3.0:1788612453.873842:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612453.873848:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932184192:12345-0@lo:400: 00000100:00100000:3.0:1788612453.873880:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932184192:12345-0@lo:400: Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.873886:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612453.873923:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932183808:0@lo:400: 00000100:00100000:3.0:1788612453.873935:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932184320:0@lo:400: 00000100:00100000:3.0:1788612453.873943:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932184832:0@lo:400: 00000100:00100000:3.0:1788612453.873951:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932184192:0@lo:400: 00000100:00100000:3.0:1788612453.874003:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932183936:0@lo:400: 00000100:00100000:3.0:1788612453.874027:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.874045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932184448:0@lo:400: 00000100:00100000:3.0:1788612453.874062:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612453.874073:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932184960:0@lo:400: 00000100:00100000:3.0:1788612453.874089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788612453.874111:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880a80 x1875495932183424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612453.874121:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788612453.874146:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932183424:0@lo:13: 00000100:00100000:3.0:1788612453.874165:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184448 00000100:00100000:3.0:1788612453.874169:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184448 00000100:00100000:3.0:1788612453.874190:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184960 00000100:00100000:3.0:1788612453.874192:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184960 00000100:00100000:3.0:1788612453.874206:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612453.874210:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932184448:12345-0@lo:400: 00000100:00100000:3.0:1788612453.874243:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932184448:12345-0@lo:400: Request processed in 32us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.874248:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612453.874260:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612453.874265:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932184960:12345-0@lo:400: 00000100:00100000:3.0:1788612453.874291:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932184960:12345-0@lo:400: Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.874297:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788612453.874309:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612453.874314:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183936 00000100:00100000:3.0:1788612453.874318:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183936 00000100:00100000:3.0:1788612453.874336:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612453.874342:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932183936:12345-0@lo:400: 00000100:00100000:3.0:1788612453.874369:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932183936:12345-0@lo:400: Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612453.874375:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612453.874414:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932183936:0@lo:400: 00010000:00080000:3.0:1788612453.874425:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e8380 x1875495932184448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612453.874433:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932184448:0@lo:400: 00010000:00080000:3.0:1788612453.874452:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed3100 x1875495932184960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612453.874460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932184960:0@lo:400: 00000100:00100000:0.0:1788612453.874838:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184576 00000100:00100000:0.0:1788612453.874843:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184576 00000100:00100000:0.0:1788612453.874882:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932184704 00000100:00100000:0.0:1788612453.874886:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932184704 00000100:00100000:0.0:1788612453.874908:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612453.874915:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932184576:12345-0@lo:400: 00000100:00100000:0.0:1788612453.874954:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932184576:12345-0@lo:400: Request processed in 40us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612453.874961:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612453.874984:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612453.874991:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932184704:12345-0@lo:400: 00000100:00100000:0.0:1788612453.875024:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932184704:12345-0@lo:400: Request processed in 34us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612453.875029:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788612453.875066:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ea680 x1875495932184704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612453.875076:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932184704:0@lo:400: 00000100:00100000:0.0:1788612453.875120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183680 00000100:00100000:0.0:1788612453.875124:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183680 00000100:00100000:0.0:1788612453.875151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788612453.875157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932183680:12345-0@lo:400: 00000100:00100000:0.0:1788612453.875194:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932183680:12345-0@lo:400: Request processed in 38us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612453.875200:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788612453.875236:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932183680:0@lo:400: 00010000:00080000:1.0:1788612453.876050:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e9f80 x1875495932184576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612453.876063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932184576:0@lo:400: 00000100:00100000:1.0:1788612453.876090:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932184064:0@lo:400: 00000100:00080000:3.0:1788612453.876306:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612453.876369:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932183552 00000100:00100000:2.0:1788612453.876375:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932183552 00000100:00100000:2.0:1788612453.876443:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612453.876451:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932183552:12345-0@lo:13: 00002000:00000024:2.0:1788612453.876468:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612453.876547:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932183552:12345-0@lo:13: Request processed in 97us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612453.876554:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788612453.876607:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788612453.876706:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7867100 x1875495932183552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612453.876715:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788612453.876730:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932183552:0@lo:13: 00000100:00100000:1.0:1788612454.383801:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932185088:0@lo:13: 00000100:00100000:1.0:1788612454.383870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612454.384117:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185088 00000100:00100000:2.0:1788612454.384125:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185088 00000100:00100000:2.0:1788612454.384168:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612454.384189:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932185088:12345-0@lo:13: 00002000:00000024:2.0:1788612454.384215:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612454.384257:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932185088:12345-0@lo:13: Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612454.384264:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788612454.384404:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864e00 x1875495932185088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612454.384556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932185088:0@lo:13: 00000100:00100000:0.0:1788612454.384752:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932185344:0@lo:41: 00000100:00100000:0.0:1788612454.384790:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612454.384826:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612454.384833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932185216:0@lo:13: 00000100:00100000:0.0:1788612454.384855:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612454.384883:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185216 00000100:00100000:0.0:1788612454.384887:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185216 00000100:00100000:0.0:1788612454.384913:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612454.384920:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932185216:12345-0@lo:13: 00002000:00000024:0.0:1788612454.385239:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612454.385279:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932185216:12345-0@lo:13: Request processed in 359us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612454.385286:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788612454.385317:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864a80 x1875495932185216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612454.385330:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932185216:0@lo:13: 00000100:00100000:1.0:1788612454.385791:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185344 00000100:00100000:1.0:1788612454.385798:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185344 00000100:00100000:1.0:1788612454.385837:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788612454.385845:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932185344:12345-0@lo:41: 00000004:00000024:1.0:1788612454.385871:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612454.385917:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932185344:12345-0@lo:41: Request processed in 72us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612454.385949:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788612454.386052:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932185344:0@lo:41: 00000100:00100000:1.0:1788612454.629672:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612454.634148:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311168 00000100:00100000:3.0:1788612454.634164:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311168 00000100:00100000:3.0:1788612454.634385:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:3.0:1788612454.634408:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:6246:x1875495914311168:12345-192.168.203.30@tcp:41: 00000004:00000024:3.0:1788612454.634447:0:8253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788612454.634542:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:6246:x1875495914311168:12345-192.168.203.30@tcp:41: Request processed in 147us (4879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612454.634549:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:0.0:1788612454.634763:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612454.639506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612454.643159:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311296 00000100:00100000:3.0:1788612454.643248:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311296 00000100:00100000:3.0:1788612454.643417:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:3.0:1788612454.643429:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6246:x1875495914311296:12345-192.168.203.30@tcp:41: 00000004:00000024:3.0:1788612454.643507:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788612454.643629:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6246:x1875495914311296:12345-192.168.203.30@tcp:41: Request processed in 202us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612454.643636:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:0.0:1788612454.646491:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612454.651333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612454.651440:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311424 00000100:00100000:0.0:1788612454.651450:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311424 00000100:00080000:3.0:1788612454.651609:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612454.652026:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1788612454.652040:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6246:x1875495914311424:12345-192.168.203.30@tcp:13: 00002000:00000024:0.0:1788612454.652067:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612454.652139:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6246:x1875495914311424:12345-192.168.203.30@tcp:13: Request processed in 102us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612454.652146:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612454.655124:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612454.656134:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311552 00000100:00100000:1.0:1788612454.656145:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311552 00000100:00100000:1.0:1788612454.656229:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1788612454.656240:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6246:x1875495914311552:12345-192.168.203.30@tcp:13: 00002000:00000024:1.0:1788612454.656263:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612454.656331:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:6246:x1875495914311552:12345-192.168.203.30@tcp:13: Request processed in 93us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612454.656338:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00080000:3.0:1788612454.656859:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788612454.767631:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612455.791620:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788612456.441256:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00010000:00010000:1.0:1788612456.816384:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788612457.007418:0:10188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788612457.455753:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932185472:0@lo:41: 00000100:00100000:2.0:1788612457.455823:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612457.456111:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185472 00000100:00100000:3.0:1788612457.456119:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185472 00000100:00100000:3.0:1788612457.456167:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788612457.456191:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932185472:12345-0@lo:41: 00000004:00000024:3.0:1788612457.456222:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788612457.457442:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932185472:12345-0@lo:41: Request processed in 1255us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612457.457453:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000001:00100000:1.0:1788612457.457814:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000001:00100000:0.0:1788612457.459885:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000100:00100000:2.0:1788612457.460047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932185472:0@lo:41: 00000100:00100000:2.0:1788612457.579896:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612457.579948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612457.579978:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612457.580014:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612457.580021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311808 00000100:00100000:1.0:1788612457.580031:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311808 00000100:00100000:2.0:1788612457.580048:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612457.580075:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312064 00000100:00100000:1.0:1788612457.580086:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311936 00000100:00100000:1.0:1788612457.580091:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311936 00000100:00100000:2.0:1788612457.580093:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312064 00000100:00100000:1.0:1788612457.580119:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1788612457.580131:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914311808:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1788612457.580158:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1788612457.580171:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914311936:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1788612457.580198:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914311808:12345-192.168.203.30@tcp:400: Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612457.580208:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1788612457.580213:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914311936:12345-192.168.203.30@tcp:400: Request processed in 42us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612457.580218:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311680 00000100:00100000:0.0:1788612457.580222:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612457.580235:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311680 00000100:00100000:3.0:1788612457.580269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1788612457.580277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914311680:12345-192.168.203.30@tcp:400: 00000100:00100000:3.0:1788612457.580308:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914311680:12345-192.168.203.30@tcp:400: Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612457.580315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00080000:1.0:1788612457.580381:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612457.580389:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612457.580392:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612457.580434:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312192 00000100:00100000:2.0:1788612457.580439:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312192 00000100:00100000:1.0:1788612457.584008:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1788612457.584031:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914312064:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1788612457.584110:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914312064:12345-192.168.203.30@tcp:400: Request processed in 90us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612457.585651:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788612457.585679:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914312192:12345-192.168.203.30@tcp:400: 00000100:00100000:2.0:1788612457.585748:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914312192:12345-192.168.203.30@tcp:400: Request processed in 84us (5699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612457.585755:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00080000:2.0:1788612457.585824:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612457.586816:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00010000:00010000:1.0:1788612457.842596:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788612458.485545:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00010000:00010000:3.0:1788612458.864115:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612458.991611:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932185600:0@lo:13: 00000100:00100000:2.0:1788612458.991716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932185984:0@lo:400: 00000100:00100000:2.0:1788612458.991771:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.991820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932186496:0@lo:400: 00000100:00100000:2.0:1788612458.991839:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.991854:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932187008:0@lo:400: 00000100:00100000:2.0:1788612458.991872:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.991893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788612458.991897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932186112:0@lo:400: 00000100:00100000:2.0:1788612458.991912:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.991929:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932186624:0@lo:400: 00000100:00100000:2.0:1788612458.991946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.991959:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932187136:0@lo:400: 00000100:00100000:2.0:1788612458.991973:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.991998:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186496 00000100:00100000:2.0:1788612458.992004:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186496 00000100:00100000:2.0:1788612458.992043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187008 00000100:00100000:2.0:1788612458.992045:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187008 00000100:00100000:2.0:1788612458.992057:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186112 00000100:00100000:2.0:1788612458.992069:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186112 00000100:00100000:2.0:1788612458.992084:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788612458.992091:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932186496:12345-0@lo:400: 00000100:00100000:2.0:1788612458.992132:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932186496:12345-0@lo:400: Request processed in 41us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.992139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788612458.992154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612458.992159:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932187008:12345-0@lo:400: 00000100:00100000:3.0:1788612458.992615:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185984 00000100:00100000:3.0:1788612458.992621:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185984 00000100:00100000:3.0:1788612458.992653:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612458.992660:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932185984:12345-0@lo:400: 00000100:00100000:0.0:1788612458.992796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932185728:0@lo:400: 00000100:00100000:3.0:1788612458.994074:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932185984:12345-0@lo:400: Request processed in 1409us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612458.994085:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788612458.995606:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612458.995686:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932185856:0@lo:400: 00000100:00100000:1.0:1788612458.995726:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612458.995740:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932186368:0@lo:400: 00000100:00100000:1.0:1788612458.995759:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612458.995770:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932186880:0@lo:400: 00000100:00100000:1.0:1788612458.995786:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612458.995797:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932187392:0@lo:13: 00000100:00100000:1.0:1788612458.995815:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612458.996027:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185600 00000100:00100000:3.0:1788612458.996035:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185600 00000100:00100000:3.0:1788612458.996074:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187392 00000100:00100000:3.0:1788612458.996077:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187392 00000100:00100000:3.0:1788612458.996096:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612458.996105:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932185600:12345-0@lo:13: 00002000:00000024:3.0:1788612458.996132:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612458.996217:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932187008:12345-0@lo:400: Request processed in 4054us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996227:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612458.996246:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185856 00000100:00100000:2.0:1788612458.996250:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185856 00000100:00100000:2.0:1788612458.996266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186368 00000100:00100000:2.0:1788612458.996269:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186368 00000100:00100000:2.0:1788612458.996281:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186880 00000100:00100000:2.0:1788612458.996283:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186880 00000100:00100000:2.0:1788612458.996295:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612458.996303:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932186112:12345-0@lo:400: 00000100:00100000:2.0:1788612458.996339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932186112:12345-0@lo:400: Request processed in 38us (4426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996345:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612458.996356:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612458.996372:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932185856:12345-0@lo:400: 00000100:00100000:2.0:1788612458.996457:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932185856:12345-0@lo:400: Request processed in 95us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996463:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612458.996494:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612458.996508:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932186368:12345-0@lo:400: 00000100:00100000:2.0:1788612458.996537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932186368:12345-0@lo:400: Request processed in 30us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996542:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612458.996558:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612458.996565:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932186880:12345-0@lo:400: 00000100:00100000:2.0:1788612458.996594:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932186880:12345-0@lo:400: Request processed in 31us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996599:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612458.996625:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186624 00000100:00100000:2.0:1788612458.996642:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186624 00000100:00100000:3.0:1788612458.996652:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932185600:12345-0@lo:13: Request processed in 547us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612458.996660:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612458.996673:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187136 00000100:00100000:2.0:1788612458.996677:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187136 00000100:00100000:3.0:1788612458.996680:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612458.996691:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875495932187392:12345-0@lo:13: 00002000:00000024:3.0:1788612458.996701:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612458.996702:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612458.996713:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932186624:12345-0@lo:400: 00000100:00100000:3.0:1788612458.996732:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875495932187392:12345-0@lo:13: Request processed in 43us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612458.996738:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612458.996759:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932186624:12345-0@lo:400: Request processed in 47us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996766:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612458.996780:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612458.996785:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932187136:12345-0@lo:400: 00000100:00100000:2.0:1788612458.996811:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932187136:12345-0@lo:400: Request processed in 26us (4837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.996817:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788612458.996835:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612458.996839:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612458.996841:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612458.996843:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612458.996888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932186112:0@lo:400: 00010000:00080000:2.0:1788612458.996902:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e8380 x1875495932186624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612458.996912:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932186624:0@lo:400: 00010000:00080000:2.0:1788612458.996921:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ea300 x1875495932187136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612458.996929:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932187136:0@lo:400: 00000100:00100000:2.0:1788612458.996941:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932185984:0@lo:400: 00010000:00080000:2.0:1788612458.996951:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ea680 x1875495932186496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612458.996958:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932186496:0@lo:400: 00010000:00080000:2.0:1788612458.996982:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76eb800 x1875495932187008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612458.996990:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932187008:0@lo:400: 00000100:00100000:1.0:1788612458.999048:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932185856:0@lo:400: 00000100:00100000:1.0:1788612458.999065:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932186368:0@lo:400: 00000100:00100000:1.0:1788612458.999076:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932186880:0@lo:400: 00010000:00080000:1.0:1788612458.999088:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f6300 x1875495932187392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612458.999127:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932187392:0@lo:13: 00010000:00080000:1.0:1788612458.999249:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880a80 x1875495932185600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612458.999262:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932185600:0@lo:13: 00000100:00100000:0.0:1788612459.004790:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612459.004845:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932186240:0@lo:400: 00000100:00100000:0.0:1788612459.004888:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612459.004919:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932186752:0@lo:400: 00000100:00100000:0.0:1788612459.004944:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612459.004964:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932187264:0@lo:400: 00000100:00100000:0.0:1788612459.004989:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612459.005281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932185728 00000100:00100000:2.0:1788612459.005289:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932185728 00000100:00100000:2.0:1788612459.005334:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788612459.005343:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932185728:12345-0@lo:400: 00000100:00100000:2.0:1788612459.005405:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932185728:12345-0@lo:400: Request processed in 62us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612459.005412:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788612459.006511:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186752 00000100:00100000:0.0:1788612459.006521:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186752 00000100:00100000:0.0:1788612459.006578:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187264 00000100:00100000:0.0:1788612459.006581:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187264 00000100:00100000:0.0:1788612459.006603:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612459.006611:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932186752:12345-0@lo:400: 00000100:00100000:0.0:1788612459.006678:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932186752:12345-0@lo:400: Request processed in 69us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612459.006684:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612459.006698:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612459.006704:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932187264:12345-0@lo:400: 00000100:00100000:0.0:1788612459.006732:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932187264:12345-0@lo:400: Request processed in 27us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612459.006738:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788612459.006757:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612459.006786:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932185728:0@lo:400: 00010000:00080000:0.0:1788612459.006802:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76eb480 x1875495932186752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612459.006813:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932186752:0@lo:400: 00010000:00080000:0.0:1788612459.006824:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e8700 x1875495932187264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612459.006831:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932187264:0@lo:400: 00000100:00100000:3.0:1788612459.007690:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932186240 00000100:00100000:3.0:1788612459.007698:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932186240 00000100:00100000:3.0:1788612459.007742:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788612459.007750:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932186240:12345-0@lo:400: 00000100:00100000:3.0:1788612459.007803:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932186240:12345-0@lo:400: Request processed in 54us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612459.007810:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612459.009050:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932186240:0@lo:400: 00000100:00100000:1.0:1788612459.503743:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612459.503771:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932187520:0@lo:41: 00000100:00100000:1.0:1788612459.503846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612459.503961:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187520 00000100:00100000:3.0:1788612459.503969:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187520 00000100:00100000:3.0:1788612459.504031:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612459.504040:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932187520:12345-0@lo:41: 00000004:00000024:3.0:1788612459.504075:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788612459.504123:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932187520:12345-0@lo:41: Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612459.504130:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612459.504182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932187520:0@lo:41: 00000100:00100000:3.0:1788612459.505037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932187648:0@lo:13: 00000100:00100000:3.0:1788612459.505088:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612459.505338:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187648 00000100:00100000:1.0:1788612459.505355:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187648 00000100:00100000:1.0:1788612459.505426:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612459.505435:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932187648:12345-0@lo:13: 00002000:00000024:1.0:1788612459.505461:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612459.505698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932187776:0@lo:13: 00000100:00100000:2.0:1788612459.505738:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612459.505782:0:8443:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788612459.505790:0:8443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788612459.506381:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932187648:12345-0@lo:13: Request processed in 944us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612459.506390:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612459.506409:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932187776 00000100:00100000:1.0:1788612459.506413:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932187776 00000100:00100000:1.0:1788612459.506434:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612459.506441:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932187776:12345-0@lo:13: 00002000:00000024:1.0:1788612459.506454:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612459.506519:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932187776:12345-0@lo:13: Request processed in 78us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612459.506525:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788612459.506868:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f7100 x1875495932187776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612459.506887:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932187776:0@lo:13: 00010000:00080000:3.0:1788612459.507011:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f7800 x1875495932187648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612459.507026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932187648:0@lo:13: 00010000:00010000:1.0:1788612459.887648:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788612460.572096:0:10336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe98522510 20000000:00000080:1.0:1788612460.572118:0:10336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9611c6a42000 uarg=0000000000000000 20000000:01000000:1.0:1788612460.572159:0:10336:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788612460.572161:0:10336:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788612460.572164:0:10336:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788612460.572168:0:10336:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788612460.572173:0:10336:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788612460.572235:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788612460.572238:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788612460.575924:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788612460.576274:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788612460.576323:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788612460.576344:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1788612460.576369:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788612460.576372:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788612460.577377:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788612460.577661:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788612460.577688:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788612460.577701:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788612460.577713:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788612460.577715:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788612460.578969:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788612460.580297:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788612460.580337:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788612460.580371:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788612460.580385:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788612460.580387:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788612460.584926:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788612460.588526:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788612460.588568:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788612460.588880:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788612460.588898:0:10336:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788612460.588901:0:10336:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788612460.591578:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788612460.592763:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788612460.592799:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788612460.592819:0:10336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1788612460.592836:0:10336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788612460.592857:0:10336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592876:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592903:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592911:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592918:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592925:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592932:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592939:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592945:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592952:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592962:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592969:0:10336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.592986:0:10336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.593026:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.593043:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 9 pid: 6518 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.593058:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932187904:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612460.593308:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.593320:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 9 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.593330:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188032:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612460.593377:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.593386:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 23 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.593395:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188160:0@lo:104: 00000100:00100000:1.0:1788612460.593435:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612460.593564:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.593659:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.593668:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188288:0@lo:104: 00000100:00100000:1.0:1788612460.593693:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612460.594291:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.594301:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 23 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.594311:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188416:0@lo:104: 00000100:00100000:1.0:1788612460.594339:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612460.596711:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.596729:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.596742:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188544:0@lo:104: 00000100:00100000:1.0:1788612460.596790:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.596855:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188160 00000100:00100000:0.0:1788612460.596862:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188160 00010000:00010000:1.0:1788612460.596872:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.596881:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.596889:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188672:0@lo:104: 00000100:00100000:0.0:1788612460.596912:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788612460.596924:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188288 00000100:00100000:0.0:1788612460.596927:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188288 00000100:00100000:1.0:1788612460.596937:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.596946:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188416 00000100:00100000:0.0:1788612460.596949:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188416 00000100:00100000:0.0:1788612460.596958:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188544 00000100:00100000:0.0:1788612460.596960:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188544 00010000:00010000:1.0:1788612460.596964:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.596968:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188672 00000100:00100000:0.0:1788612460.596971:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188672 00010000:00010000:1.0:1788612460.596973:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 23 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.596982:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188800:0@lo:104: 00000100:00100000:0.0:1788612460.596983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612460.596990:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:10336:x1875495932188160:12345-0@lo:104: 00000100:00100000:1.0:1788612460.597002:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612460.597003:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.597016:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.597022:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.597030:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188928:0@lo:104: 00000100:00100000:1.0:1788612460.597048:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612460.597056:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612460.597062:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:10336:x1875495932188160:12345-0@lo:104: Request processed in 72us (3628us total) trans 0 rc 0/0 00010000:00010000:1.0:1788612460.597063:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.597069:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788612460.597071:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.597078:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932189056:0@lo:104: 00000100:00100000:0.0:1788612460.597085:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188800 00000100:00100000:0.0:1788612460.597088:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188800 00000100:00100000:1.0:1788612460.597095:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.597099:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932188928 00000100:00100000:0.0:1788612460.597101:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932188928 00010000:00010000:1.0:1788612460.597110:0:10336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.597110:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189056 00000100:00100000:0.0:1788612460.597111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189056 00010000:00010000:1.0:1788612460.597118:0:10336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.597122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612460.597127:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:10336:x1875495932188288:12345-0@lo:104: 00010000:00010000:0.0:1788612460.597134:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.597137:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932189184:0@lo:104: 00000100:00100000:1.0:1788612460.597156:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612460.597175:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9540 going to sleep for 11 seconds 00010000:00010000:0.0:1788612460.597178:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612460.597183:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:10336:x1875495932188288:12345-0@lo:104: Request processed in 56us (3489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.597188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612460.597194:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188160:0@lo:104: 00000100:00100000:1.0:1788612460.597202:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188288:0@lo:104: 00000100:00100000:0.0:1788612460.597205:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189184 00000100:00100000:0.0:1788612460.597207:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189184 00000100:00100000:0.0:1788612460.597219:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612460.597224:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:10336:x1875495932188416:12345-0@lo:104: 00010000:00010000:0.0:1788612460.597231:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.597273:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788612460.597278:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+9:10336:x1875495932188416:12345-0@lo:104: Request processed in 55us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.597284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612460.597296:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612460.597301:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fecf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+8:10336:x1875495932188544:12345-0@lo:104: 00010000:00010000:0.0:1788612460.597308:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.597333:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788612460.597337:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fecf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+8:10336:x1875495932188544:12345-0@lo:104: Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.597343:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612460.597380:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612460.597386:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:10336:x1875495932188672:12345-0@lo:104: 00010000:00010000:0.0:1788612460.597393:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.597417:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788612460.597421:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+7:10336:x1875495932188672:12345-0@lo:104: Request processed in 36us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.597436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612460.597449:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612460.597455:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:10336:x1875495932188800:12345-0@lo:104: 00000100:00100000:1.0:1788612460.597461:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188416:0@lo:104: 00010000:00010000:0.0:1788612460.597462:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.597468:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188544:0@lo:104: 00000100:00100000:1.0:1788612460.597498:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188672:0@lo:104: 00010000:00010000:0.0:1788612460.597505:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788612460.597507:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188800:0@lo:104: 00000100:00100000:0.0:1788612460.597510:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:10336:x1875495932188800:12345-0@lo:104: Request processed in 56us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.597516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612460.597527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612460.597533:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:10336:x1875495932188928:12345-0@lo:104: 00010000:00010000:0.0:1788612460.597540:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.597578:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788612460.597797:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188928:0@lo:104: 00000100:00100000:0.0:1788612460.598064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:10336:x1875495932188928:12345-0@lo:104: Request processed in 531us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.598071:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612460.598085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788612460.598092:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:10336:x1875495932189056:12345-0@lo:104: 00010000:00010000:0.0:1788612460.598100:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598141:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788612460.598146:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:10336:x1875495932189056:12345-0@lo:104: Request processed in 55us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.598166:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788612460.598180:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612460.598186:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:10336:x1875495932189184:12345-0@lo:104: 00010000:00010000:0.0:1788612460.598193:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598217:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788612460.598221:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:10336:x1875495932189184:12345-0@lo:104: Request processed in 36us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.598227:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788612460.598243:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788612460.598248:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598255:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.598260:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598268:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.598275:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.598281:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.598312:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598319:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.598344:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598362:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc7f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598376:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788612460.598380:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598386:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.598389:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598396:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.598403:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.598409:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.598421:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598426:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.598438:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598445:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc7f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f5e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598453:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788612460.598460:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598466:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.598469:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598502:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.598508:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.598514:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.598526:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598532:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.598537:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598543:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897400/0x1f8616bf0bc7f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598553:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788612460.598556:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598560:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.598562:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598579:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.598708:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.598714:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.598730:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598735:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.598816:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598825:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc7f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7f18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598835:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788612460.598839:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598844:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.598848:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598855:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.598861:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.598872:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.598898:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598904:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.598908:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598916:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc7ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7efc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598925:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788612460.598928:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598934:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.598937:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598943:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.598949:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.598954:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.598963:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598968:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.598976:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598983:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897000/0x1f8616bf0bc7ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7eee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.598991:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788612460.598994:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599000:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.599003:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599010:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.599016:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.599021:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.599030:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599035:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.599038:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599044:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897c00/0x1f8616bf0bc7ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ee0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599051:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612460.599058:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599064:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.599067:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599073:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.599079:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.599084:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.599105:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599110:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.599114:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599120:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc7e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7ea1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599129:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612460.599132:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599137:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612460.599141:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599543:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612460.599554:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612460.599561:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612460.599590:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599596:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612460.599601:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599608:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896c00/0x1f8616bf0bc7e70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e77 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.599623:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612460.599625:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612460.599627:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612460.599636:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612460.599649:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932189312:0@lo:103: 00000100:00100000:0.0:1788612460.599702:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.599818:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932189824:0@lo:103: 00000100:00100000:0.0:1788612460.599839:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.599857:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932190336:0@lo:103: 00000100:00100000:0.0:1788612460.599872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.599892:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788612460.599906:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932189696:0@lo:103: 00000100:00100000:0.0:1788612460.599932:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.599945:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932190208:0@lo:103: 00000100:00100000:0.0:1788612460.599960:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.599982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932189440:0@lo:103: 00000100:00100000:0.0:1788612460.599998:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.600006:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932189952:0@lo:103: 00000100:00100000:0.0:1788612460.600019:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.600028:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788612460.600033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932189568:0@lo:103: 00000100:00100000:0.0:1788612460.600047:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.600054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932190080:0@lo:103: 00000100:00100000:0.0:1788612460.600067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612460.600089:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189312 00000100:00100000:0.0:1788612460.600094:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189312 00010000:00010000:0.0:1788612460.600118:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 24 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600137:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189824 00000100:00100000:0.0:1788612460.600139:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189824 00010000:00010000:0.0:1788612460.600147:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 25 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600155:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190336 00000100:00100000:0.0:1788612460.600157:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190336 00010000:00010000:0.0:1788612460.600178:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 26 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600187:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189696 00000100:00100000:0.0:1788612460.600194:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189696 00010000:00010000:0.0:1788612460.600204:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 27 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600214:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190208 00000100:00100000:0.0:1788612460.600216:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190208 00010000:00010000:0.0:1788612460.600224:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 28 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600233:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189440 00000100:00100000:0.0:1788612460.600234:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189440 00010000:00010000:0.0:1788612460.600241:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 29 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600249:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189952 00000100:00100000:0.0:1788612460.600251:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189952 00010000:00010000:0.0:1788612460.600258:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 30 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600267:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932189568 00000100:00100000:0.0:1788612460.600268:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932189568 00010000:00010000:0.0:1788612460.600276:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 31 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600284:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190080 00000100:00100000:0.0:1788612460.600286:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190080 00010000:00010000:0.0:1788612460.600293:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 32 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.600304:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612460.600311:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9284050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+32:3651:x1875495932189312:12345-0@lo:103: 00010000:00010000:0.0:1788612460.600322:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612460.600332:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 32 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600342:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 32 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600364:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc7f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7f81 expref: 32 pid: 6517 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600378:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612460.600410:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9284050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+31:3651:x1875495932189312:12345-0@lo:103: Request processed in 100us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.600417:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612460.600457:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612460.600462:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+30:3651:x1875495932189824:12345-0@lo:103: 00010000:00010000:0.0:1788612460.600469:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612460.600473:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 30 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600505:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 30 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600516:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897600/0x1f8616bf0bc7efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7ef5 expref: 30 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600525:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612460.600545:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+29:3651:x1875495932189824:12345-0@lo:103: Request processed in 82us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.600552:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612460.600566:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612460.600577:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+28:3651:x1875495932190336:12345-0@lo:103: 00000100:00100000:1.0:1788612460.600664:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932189056:0@lo:104: 00000100:00100000:1.0:1788612460.600674:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932189184:0@lo:104: 00010000:00010000:0.0:1788612460.600884:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612460.600889:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 28 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600898:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 28 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600908:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897e00/0x1f8616bf0bc7e77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7e70 expref: 28 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.600917:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612460.600939:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+27:3651:x1875495932190336:12345-0@lo:103: Request processed in 362us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.604875:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612460.604900:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+27:3651:x1875495932189696:12345-0@lo:103: 00000100:00100000:0.0:1788612460.604902:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788612460.604929:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612460.604941:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 26 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612460.604948:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612460.604958:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+26:3651:x1875495932190208:12345-0@lo:103: 00010000:00010000:0.0:1788612460.604967:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612460.604973:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 26 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.604987:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 26 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.605005:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897800/0x1f8616bf0bc7ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7e9a expref: 26 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.605029:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 25 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612460.605052:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612460.605063:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3648:x1875495932189440:12345-0@lo:103: 00010000:00010000:1.0:1788612460.605071:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612460.605076:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 25 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612460.605828:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932187904:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612460.605844:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10336:1875495932188032:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612460.605888:0:10336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.605949:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612460.606008:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3651:x1875495932190208:12345-0@lo:103: Request processed in 1052us (6045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612460.606032:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612460.606050:0:7465:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788612460.606057:0:7465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788612460.606100:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932190208:0@lo:103: 00000100:00100000:0.0:1788612460.606109:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932189312:0@lo:103: 00000100:00100000:0.0:1788612460.606117:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932189824:0@lo:103: 00000100:00100000:0.0:1788612460.606124:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932190336:0@lo:103: 00010000:00010000:2.0:1788612460.606414:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc7f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7f11 expref: 24 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.606423:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 24 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.606436:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612460.606442:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc7f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7f57 expref: 23 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612460.606453:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612460.606552:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932189696:0@lo:103: 00000100:00100000:2.0:1788612460.606569:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:3651:x1875495932189696:12345-0@lo:103: Request processed in 1679us (6633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.606577:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612460.606610:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612460.606620:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3648:x1875495932189952:12345-0@lo:103: 00010000:00010000:2.0:1788612460.606634:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612460.606640:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 21 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.606649:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 21 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.606861:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe924c00/0x1f8616bf0bc7eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7ee7 expref: 21 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.606872:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612460.606908:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3648:x1875495932189952:12345-0@lo:103: Request processed in 291us (6887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.606917:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612460.606940:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612460.607062:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3648:x1875495932189568:12345-0@lo:103: 00010000:00010000:2.0:1788612460.607072:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612460.607078:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 19 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.607089:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 19 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.607102:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc7f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7f3b expref: 19 pid: 6516 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.607112:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612460.607141:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:3648:x1875495932189568:12345-0@lo:103: Request processed in 85us (7092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.607150:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612460.607167:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612460.607174:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:3648:x1875495932190080:12345-0@lo:103: 00010000:00010000:2.0:1788612460.607634:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612460.607641:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 17 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.607673:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 17 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.607687:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1c00/0x1f8616bf0bc7ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7ed9 expref: 17 pid: 6518 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.607700:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612460.607738:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:3648:x1875495932190080:12345-0@lo:103: Request processed in 563us (7667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.607745:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612460.607799:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932189568:0@lo:103: 00000100:00100000:2.0:1788612460.607816:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932190080:0@lo:103: 00000100:00100000:2.0:1788612460.607831:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932189952:0@lo:103: 00000100:00100000:1.0:1788612460.609056:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:3648:x1875495932189440:12345-0@lo:103: Request processed in 3990us (9051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612460.609067:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612460.609146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612460.609739:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932189440:0@lo:103: 00000100:00100000:1.0:1788612460.609848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612460.610092:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312320 00000100:00100000:3.0:1788612460.610101:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312320 00010000:00010000:3.0:1788612460.610133:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 10 pid: 6518 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612460.610236:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312448 00000100:00100000:3.0:1788612460.610240:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312448 00010000:00010000:3.0:1788612460.610253:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 11 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612460.610284:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1788612460.610296:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:2394:x1875495914312320:12345-192.168.203.30@tcp:103: 00010000:00010000:2.0:1788612460.610310:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612460.610316:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 11 pid: 6518 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610327:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 11 pid: 6518 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610344:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc7f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fdd expref: 11 pid: 6518 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610384:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612460.610444:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2394:x1875495914312320:12345-192.168.203.30@tcp:103: Request processed in 150us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.610451:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1788612460.610466:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1788612460.610472:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:2395:x1875495914312448:12345-192.168.203.30@tcp:103: 00010000:00010000:2.0:1788612460.610504:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612460.610509:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 9 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610517:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 9 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610527:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc7f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d21fd6 expref: 9 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610539:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610546:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610560:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610567:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610573:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610660:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610666:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612460.610670:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610678:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610694:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612460.610705:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612460.610725:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:2395:x1875495914312448:12345-192.168.203.30@tcp:103: Request processed in 253us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612460.610732:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00010000:00010000:3.0:1788612460.612069:0:10336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612460.612084:0:10336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612460.612104:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc7fdc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612460.915323:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612461.743606:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788612461.743623:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9611c67e2000 from 48 10000000:01000000:3.0:1788612461.743628:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612461.743679:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.743691:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.743702:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.743738:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932190464:0@lo:101: 00000100:00100000:3.0:1788612461.743810:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.743877:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.743962:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190464 00000100:00100000:0.0:1788612461.743970:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190464 00000100:00100000:0.0:1788612461.744039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788612461.744050:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+15:6520:x1875495932190464:12345-0@lo:101: 00010000:00010000:0.0:1788612461.744062:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612461.744077:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7fe3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.744099:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7fe3 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.744109:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7fe3 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.744118:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924400, rc 0) 00000100:00100000:0.0:1788612461.744170:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932190464:12345-0@lo:101: Request processed in 122us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.744191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788612461.744580:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932190464:0@lo:101: 00010000:00010000:3.0:1788612461.744596:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.744605:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.744661:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932190592:0@lo:501: 00000100:00100000:3.0:1788612461.744688:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.744771:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.746077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190592 00000100:00100000:2.0:1788612461.746088:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190592 00000100:00100000:2.0:1788612461.746199:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788612461.746209:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932190592:12345-0@lo:501: 00000100:00100000:2.0:1788612461.746373:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932190592:12345-0@lo:501: Request processed in 165us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.746381:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788612461.746467:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932190592:0@lo:501: 00000100:00100000:3.0:1788612461.746536:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932190720:0@lo:503: 00000100:00100000:3.0:1788612461.746605:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.747222:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.747290:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190720 00000100:00100000:0.0:1788612461.747295:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190720 00000100:00100000:0.0:1788612461.747327:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788612461.747336:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932190720:12345-0@lo:503: 00000100:00100000:0.0:1788612461.747452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932190720:12345-0@lo:503: Request processed in 116us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.747459:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788612461.747577:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932190720:0@lo:503: 00000100:00100000:3.0:1788612461.748291:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10355:1875495932190848:0@lo:502: 00000100:00100000:3.0:1788612461.748339:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.748381:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.748429:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190848 00000100:00100000:0.0:1788612461.748435:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190848 00000100:00100000:0.0:1788612461.748459:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788612461.748465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:10355:x1875495932190848:12345-0@lo:502: 00000100:00100000:0.0:1788612461.748600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:10355:x1875495932190848:12345-0@lo:502: Request processed in 134us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.748606:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788612461.748990:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10355:1875495932190848:0@lo:502: 00000100:00100000:3.0:1788612461.749034:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10355:1875495932190976:0@lo:502: 00000100:00100000:3.0:1788612461.749069:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.749098:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.749204:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932190976 00000100:00100000:0.0:1788612461.749209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932190976 00000100:00100000:0.0:1788612461.749228:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788612461.749235:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:10355:x1875495932190976:12345-0@lo:502: 00000100:00100000:0.0:1788612461.749309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:10355:x1875495932190976:12345-0@lo:502: Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.749316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788612461.749449:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10355:1875495932190976:0@lo:502: 00000040:00080000:3.0:1788612461.749470:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788612461.749955:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788612461.749976:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612461.749997:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.750023:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612461.750033:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788612461.750036:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788612461.750038:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788612461.750067:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.750075:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.750083:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612461.750096:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191104:0@lo:101: 00000100:00100000:0.0:1788612461.750132:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.750331:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.750464:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191104 00000100:00100000:1.0:1788612461.750472:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191104 00000100:00100000:2.0:1788612461.750946:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788612461.750957:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+16:6520:x1875495932191104:12345-0@lo:101: 00010000:00010000:2.0:1788612461.750969:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612461.751001:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1000/0x1f8616bf0bc7ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7ff1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.751028:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1000/0x1f8616bf0bc7ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ff1 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.751041:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1000/0x1f8616bf0bc7ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7ff1 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.751049:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1000, rc 0) 00000100:00100000:2.0:1788612461.751104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932191104:12345-0@lo:101: Request processed in 149us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.751110:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788612461.751259:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191104:0@lo:101: 00010000:00010000:0.0:1788612461.751273:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.751282:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612461.751356:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191232:0@lo:501: 00000100:00100000:0.0:1788612461.751385:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.751423:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.751505:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191232 00000100:00100000:2.0:1788612461.751510:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191232 00000100:00100000:2.0:1788612461.751545:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788612461.751552:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932191232:12345-0@lo:501: 00000100:00100000:2.0:1788612461.751693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932191232:12345-0@lo:501: Request processed in 141us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.751700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788612461.752223:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191232:0@lo:501: 00000100:00100000:3.0:1788612461.752260:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191360:0@lo:503: 00000100:00100000:3.0:1788612461.752309:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.752339:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.752429:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191360 00000100:00100000:2.0:1788612461.752434:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191360 00000100:00100000:2.0:1788612461.752470:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788612461.752503:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932191360:12345-0@lo:503: 00000100:00100000:2.0:1788612461.752611:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932191360:12345-0@lo:503: Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.752941:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788612461.753114:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191360:0@lo:503: 00000100:00100000:3.0:1788612461.753451:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10356:1875495932191488:0@lo:502: 00000100:00100000:3.0:1788612461.753522:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.753545:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.753602:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191488 00000100:00100000:0.0:1788612461.753904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191488 00000100:00100000:0.0:1788612461.753947:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788612461.753957:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:10356:x1875495932191488:12345-0@lo:502: 00000100:00100000:0.0:1788612461.754076:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:10356:x1875495932191488:12345-0@lo:502: Request processed in 120us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.754083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788612461.757211:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10356:1875495932191488:0@lo:502: 00000020:01000000:3.0:1788612461.757271:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612461.757282:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612461.757285:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788612461.757289:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788612461.757328:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10356:1875495932191616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.757404:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.757437:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.757905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191616 00000100:00100000:0.0:1788612461.757912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191616 00000100:00100000:0.0:1788612461.757964:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788612461.757974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:10356:x1875495932191616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.763151:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:10356:x1875495932191616:12345-0@lo:502:llog_process_th.0 Request processed in 5170us (5738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.763167:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788612461.770207:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10356:1875495932191616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612461.770260:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612461.770271:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612461.770274:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788612461.770278:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788612461.770945:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788612461.770969:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788612461.771300:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.771313:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612461.771323:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612461.771326:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fcfb4000 from 48 10000000:01000000:0.0:1788612461.771328:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612461.771375:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.771399:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.771409:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612461.771432:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.771534:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.771592:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.771617:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191744 00000100:00100000:2.0:1788612461.771634:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191744 00000100:00100000:2.0:1788612461.771690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788612461.771699:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+17:6520:x1875495932191744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612461.771711:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612461.771725:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc8006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc7fff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.771747:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc8006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc7fff expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.771758:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc8006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7fff expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.771765:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0000, rc 0) 00000100:00100000:2.0:1788612461.771822:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932191744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.771834:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788612461.775321:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612461.775362:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.775374:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612461.775521:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.775582:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.775621:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c73f6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.775993:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932191872 00000100:00100000:0.0:1788612461.776000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932191872 00000100:00100000:0.0:1788612461.776052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788612461.776061:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932191872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.776292:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932191872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.776299:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788612461.776384:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932191872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.776417:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.776508:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.776534:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c73f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.785575:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192000 00000100:00100000:3.0:1788612461.785590:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192000 00000100:00100000:3.0:1788612461.785654:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788612461.785665:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932192000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.785828:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932192000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (9319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.785836:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788612461.786006:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.786988:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10357:1875495932192128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.787044:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.787122:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.787315:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192128 00000100:00100000:0.0:1788612461.787323:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192128 00000100:00100000:0.0:1788612461.788657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788612461.788673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:10357:x1875495932192128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.788835:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:10357:x1875495932192128:12345-0@lo:502:llog_process_th.0 Request processed in 168us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.788843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788612461.789193:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10357:1875495932192128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.789253:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10357:1875495932192256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.789296:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.789501:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.789686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192256 00000100:00100000:3.0:1788612461.789693:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192256 00000100:00100000:3.0:1788612461.789722:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788612461.789731:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:10357:x1875495932192256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.789833:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:10357:x1875495932192256:12345-0@lo:502:llog_process_th.0 Request processed in 103us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.789847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788612461.789952:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10357:1875495932192256:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788612461.789975:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788612461.790133:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788612461.790155:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612461.790165:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.790177:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612461.790187:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788612461.790189:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788612461.790192:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788612461.790218:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.790226:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.790235:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.790249:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.790280:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.790350:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.790619:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192384 00000100:00100000:0.0:1788612461.790625:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192384 00000100:00100000:1.0:1788612461.790727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788612461.790739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+18:6520:x1875495932192384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612461.790749:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612461.790762:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc8014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc800d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.790783:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc8014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc800d expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.790793:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc8014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc800d expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.790801:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4800, rc 0) 00000100:00100000:1.0:1788612461.790879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932192384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.790885:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788612461.791016:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612461.791030:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.791040:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612461.791157:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.791185:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.791211:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c73f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.791252:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192512 00000100:00100000:3.0:1788612461.791257:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192512 00000100:00100000:3.0:1788612461.791277:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788612461.791283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932192512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.791403:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932192512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.791410:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788612461.791472:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.791528:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.791564:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.791580:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c73f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.791633:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192640 00000100:00100000:3.0:1788612461.791637:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192640 00000100:00100000:3.0:1788612461.791655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788612461.791662:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932192640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.791744:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932192640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.791751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788612461.791815:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932192640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.792103:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10358:1875495932192768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.792139:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.792166:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c73f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.792201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192768 00000100:00100000:3.0:1788612461.792206:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192768 00000100:00100000:3.0:1788612461.792223:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788612461.792229:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:10358:x1875495932192768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.792301:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:10358:x1875495932192768:12345-0@lo:502:llog_process_th.0 Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.792308:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788612461.792377:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10358:1875495932192768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612461.792399:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612461.792412:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612461.792415:0:10358:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612461.792421:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788612461.792440:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10358:1875495932192896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.792554:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.792570:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1fe8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.792623:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932192896 00000100:00100000:3.0:1788612461.792628:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932192896 00000100:00100000:3.0:1788612461.792647:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788612461.792653:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:10358:x1875495932192896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.792729:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:10358:x1875495932192896:12345-0@lo:502:llog_process_th.0 Request processed in 74us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.792736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788612461.792799:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10358:1875495932192896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612461.792817:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612461.792822:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612461.792823:0:10358:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788612461.792827:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788612461.792952:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788612461.792972:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788612461.792980:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.792991:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612461.793000:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788612461.793002:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fccf8000 from 48 10000000:01000000:3.0:1788612461.793005:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612461.793029:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.793036:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.793045:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.793056:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.793079:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.793105:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.793144:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193024 00000100:00100000:2.0:1788612461.793148:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193024 00000100:00100000:2.0:1788612461.793166:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788612461.793172:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:6520:x1875495932193024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612461.793180:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612461.793192:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc8022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc801b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.793209:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc8022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc801b expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.793219:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc8022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc801b expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.793226:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0e00, rc 0) 00000100:00100000:2.0:1788612461.793262:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932193024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.793268:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788612461.793359:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612461.793370:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.793384:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.793428:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.793453:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.793510:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.793560:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193152 00000100:00100000:2.0:1788612461.793564:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193152 00000100:00100000:2.0:1788612461.793582:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788612461.793588:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932193152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.793683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932193152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.793690:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788612461.793749:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.793774:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.793811:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.793832:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.793871:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193280 00000100:00100000:2.0:1788612461.793875:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193280 00000100:00100000:2.0:1788612461.793893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788612461.793899:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932193280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.793981:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932193280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.793987:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788612461.794049:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.794371:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10359:1875495932193408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.794404:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.794417:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.794521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612461.794537:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193408 00000100:00100000:2.0:1788612461.794541:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193408 00000100:00100000:2.0:1788612461.794558:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312576 00000100:00100000:2.0:1788612461.794560:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312576 00000100:00100000:2.0:1788612461.794571:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788612461.794577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:10359:x1875495932193408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.794652:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:10359:x1875495932193408:12345-0@lo:502:llog_process_th.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.794658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788612461.794680:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:2.0:1788612461.794687:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:6166:x1875495914312576:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1788612461.794695:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612461.794716:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc8029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2204d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.794736:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc8029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2204d expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.794746:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc8029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2204d expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.794754:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1600, rc 0) 00000100:00100000:2.0:1788612461.794793:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914312576:12345-192.168.203.30@tcp:101: Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.794800:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:3.0:1788612461.794879:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10359:1875495932193408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.794911:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10359:1875495932193536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.794939:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.794966:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.795000:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193536 00000100:00100000:2.0:1788612461.795003:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193536 00000100:00100000:2.0:1788612461.795019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788612461.795024:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:10359:x1875495932193536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.795085:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:10359:x1875495932193536:12345-0@lo:502:llog_process_th.0 Request processed in 60us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.795091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788612461.795147:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10359:1875495932193536:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788612461.795163:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788612461.795288:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788612461.795305:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612461.795313:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.795322:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612461.795332:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788612461.795340:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788612461.795353:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788612461.795370:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.795378:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.795386:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612461.795398:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.795422:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.795444:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.795677:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193664 00000100:00100000:3.0:1788612461.795683:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193664 00000100:00100000:3.0:1788612461.795704:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788612461.795717:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932193664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612461.795724:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612461.795733:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc8037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8030 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.795748:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc8037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8030 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.795757:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc8037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8030 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.795764:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3e00, rc 0) 00000100:00100000:3.0:1788612461.795800:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932193664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.795805:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788612461.795866:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612461.795877:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.795884:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612461.795927:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.795951:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.795970:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.796027:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193792 00000100:00100000:0.0:1788612461.796039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193792 00000100:00100000:0.0:1788612461.796056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788612461.796062:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932193792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.796165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932193792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.796171:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788612461.796241:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.796266:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.796298:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.796318:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.796423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932193920 00000100:00100000:3.0:1788612461.796428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932193920 00000100:00100000:3.0:1788612461.796445:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788612461.796451:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932193920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.796552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932193920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.796558:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788612461.796631:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932193920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.797078:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10360:1875495932194048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.797112:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.797140:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.797177:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194048 00000100:00100000:3.0:1788612461.797182:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194048 00000100:00100000:3.0:1788612461.797211:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788612461.797218:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10360:x1875495932194048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612461.797296:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10360:x1875495932194048:12345-0@lo:502:llog_process_th.0 Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.797311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788612461.797382:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10360:1875495932194048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612461.797405:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612461.797413:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612461.797416:0:10360:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612461.797421:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788612461.797440:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10360:1875495932194176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612461.797470:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612461.797504:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.797555:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194176 00000100:00100000:0.0:1788612461.797560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194176 00000100:00100000:0.0:1788612461.797578:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788612461.797584:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10360:x1875495932194176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.797664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10360:x1875495932194176:12345-0@lo:502:llog_process_th.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.797670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788612461.797759:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10360:1875495932194176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612461.797777:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612461.797781:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612461.797783:0:10360:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788612461.797786:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000100:00100000:2.0:1788612461.798073:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000020:01000000:0.0:1788612461.798133:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788612461.798153:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788612461.798161:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.798169:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612461.798178:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612461.798181:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612c7237000 from 48 10000000:01000000:0.0:1788612461.798183:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612461.798206:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.798214:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.798232:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612461.798246:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.798272:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.798301:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612461.798352:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312704 00000100:00100000:2.0:1788612461.798356:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312704 00000100:00100000:2.0:1788612461.798376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:2.0:1788612461.798382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914312704:12345-192.168.203.30@tcp:501: 00000100:00100000:2.0:1788612461.798508:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914312704:12345-192.168.203.30@tcp:501: Request processed in 125us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.798514:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:2.0:1788612461.798533:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194304 00000100:00100000:2.0:1788612461.798541:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194304 00000100:00100000:2.0:1788612461.798556:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788612461.798561:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612461.798568:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612461.798580:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc8045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc803e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.798597:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc8045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc803e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.798606:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc8045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc803e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.798613:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1200, rc 0) 00000100:00100000:2.0:1788612461.798642:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.798647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788612461.798845:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612461.798858:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.798867:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612461.798920:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.798946:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.799006:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018540 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.799382:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194432 00000100:00100000:1.0:1788612461.799388:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194432 00000100:00100000:1.0:1788612461.799426:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788612461.799434:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932194432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.799548:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932194432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.799567:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788612461.799703:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.799732:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.799779:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.799795:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018540 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.799891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194560 00000100:00100000:1.0:1788612461.799895:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194560 00000100:00100000:1.0:1788612461.799922:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788612461.799928:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932194560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.800012:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932194560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.800019:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788612461.800814:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.801029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612461.801085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312832 00000100:00100000:3.0:1788612461.801090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312832 00000100:00100000:3.0:1788612461.801126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:3.0:1788612461.801134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914312832:12345-192.168.203.30@tcp:503: 00000100:00100000:3.0:1788612461.801229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914312832:12345-192.168.203.30@tcp:503: Request processed in 95us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612461.801237:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:0.0:1788612461.802419:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10361:1875495932194688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.802519:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.802559:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.802821:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194688 00000100:00100000:1.0:1788612461.802827:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194688 00000100:00100000:1.0:1788612461.802865:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788612461.802874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10361:x1875495932194688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612461.802978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10361:x1875495932194688:12345-0@lo:502:llog_process_th.0 Request processed in 105us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.802986:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788612461.803074:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10361:1875495932194688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.803116:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10361:1875495932194816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.803149:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.803181:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.803267:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194816 00000100:00100000:1.0:1788612461.803271:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194816 00000100:00100000:1.0:1788612461.803298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788612461.803304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10361:x1875495932194816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612461.803372:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10361:x1875495932194816:12345-0@lo:502:llog_process_th.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.803378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788612461.803958:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10361:1875495932194816:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788612461.803979:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788612461.804130:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788612461.804218:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612461.804228:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.804240:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612461.804250:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788612461.804252:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788612461.804255:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788612461.804280:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.804288:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.804297:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.804312:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.804363:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.804433:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.804621:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932194944 00000100:00100000:1.0:1788612461.804626:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932194944 00000100:00100000:1.0:1788612461.804690:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788612461.804702:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932194944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612461.804713:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612461.804724:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc8053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc804c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.804755:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc8053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc804c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.804765:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc8053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc804c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.804774:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4400, rc 0) 00000100:00100000:1.0:1788612461.804848:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932194944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.804854:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788612461.805022:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932194944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612461.805036:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612461.805044:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612461.805097:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.805122:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.805189:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.805266:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195072 00000100:00100000:1.0:1788612461.805271:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195072 00000100:00100000:1.0:1788612461.805326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788612461.805333:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932195072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.805450:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932195072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.805458:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788612461.805540:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.805571:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612461.805608:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612461.807443:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612461.807781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612461.807944:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195200 00000100:00100000:2.0:1788612461.807952:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195200 00000100:00100000:2.0:1788612461.807998:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788612461.808008:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932195200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612461.808715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932195200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 705us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.808723:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788612461.809632:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612461.810353:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10362:1875495932195328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.810428:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.810531:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.810580:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195328 00000100:00100000:1.0:1788612461.810587:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195328 00000100:00100000:1.0:1788612461.810623:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788612461.810632:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10362:x1875495932195328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612461.810744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10362:x1875495932195328:12345-0@lo:502:llog_process_th.0 Request processed in 113us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.810758:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788612461.810835:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10362:1875495932195328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612461.810860:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612461.810868:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612461.810874:0:10362:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788612461.810880:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788612461.810898:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10362:1875495932195456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612461.810926:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612461.810950:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.810988:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195456 00000100:00100000:1.0:1788612461.810992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195456 00000100:00100000:1.0:1788612461.811019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788612461.811025:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10362:x1875495932195456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612461.811077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10362:x1875495932195456:12345-0@lo:502:llog_process_th.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.811083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788612461.811144:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10362:1875495932195456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612461.811168:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612461.811171:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612461.811173:0:10362:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788612461.811176:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788612461.811377:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788612461.811402:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788612461.811414:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.811425:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612461.811435:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788612461.811437:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9612d1e64d40 from 1 10000000:01000000:1.0:1788612461.811441:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788612461.811465:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.811501:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.811512:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612461.811526:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.811560:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612461.811577:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612461.811643:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195584 00000100:00100000:0.0:1788612461.811647:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195584 00000100:00100000:0.0:1788612461.811669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788612461.811675:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932195584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612461.811692:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612461.811703:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe924a00/0x1f8616bf0bc8061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc805a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.811721:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe924a00/0x1f8616bf0bc8061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc805a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.811730:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe924a00/0x1f8616bf0bc8061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc805a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612461.811738:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924a00, rc 0) 00000100:00100000:0.0:1788612461.811763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932195584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.811768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788612461.811829:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612461.811841:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.811854:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612461.811899:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.811923:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612461.811937:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612461.811953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312960 00000100:00100000:1.0:1788612461.811957:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312960 00000100:00100000:1.0:1788612461.811973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195712 00000100:00100000:1.0:1788612461.811976:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195712 00000100:00100000:1.0:1788612461.811989:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:1.0:1788612461.811995:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6647:x1875495914312960:12345-192.168.203.30@tcp:502: 00000100:00100000:1.0:1788612461.812095:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6647:x1875495914312960:12345-192.168.203.30@tcp:502: Request processed in 98us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612461.812102:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:1.0:1788612461.812119:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788612461.812125:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932195712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.812390:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932195712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (465us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612461.812398:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788612461.812433:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932195712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788612461.812455:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788612461.812460:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612461.812467:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612461.814141:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612461.814229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313088 00000100:00100000:0.0:1788612461.814236:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313088 00000100:00100000:0.0:1788612461.814315:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:0.0:1788612461.814325:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6647:x1875495914313088:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612461.814510:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6647:x1875495914313088:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612461.814517:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:3.0:1788612461.819796:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612461.820750:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313216 00000100:00100000:2.0:1788612461.820761:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313216 00000100:00100000:2.0:1788612461.820817:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:2.0:1788612461.820841:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914313216:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612461.820857:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612461.820874:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0200/0x1f8616bf0bc8068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22054 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.820902:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0200/0x1f8616bf0bc8068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22054 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.820914:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0200/0x1f8616bf0bc8068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22054 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612461.820923:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0200, rc 0) 00000100:00100000:2.0:1788612461.820991:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914313216:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 153us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612461.820999:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:3.0:1788612461.824586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612461.824616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313344 00000100:00100000:1.0:1788612461.824626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313344 00000100:00100000:1.0:1788612461.824681:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:1.0:1788612461.824692:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914313344:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612461.824806:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914313344:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 115us (228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612461.824815:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00010000:00010000:2.0:1788612461.935773:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612462.575689:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932195840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612462.575774:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612462.575875:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932195840 00000100:00100000:0.0:1788612462.575883:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932195840 00000100:00100000:0.0:1788612462.575935:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612462.575945:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932195840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612462.575978:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612462.576026:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932195840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612462.576046:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612462.576093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932195840:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788612462.587851:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff409c55d0 20000000:00000080:1.0:1788612462.587868:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9611c6a41000 uarg=0000000000000000 20000000:01000000:1.0:1788612462.587907:0:10399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612462.587912:0:10399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612462.587917:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788612462.588703:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788612462.591462:0:10399:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788612462.596704:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788612462.596735:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788612462.596748:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788612462.596763:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788612462.596781:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596799:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596823:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596830:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596836:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596845:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596852:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596885:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.596900:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 9 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.596914:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932195968:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612462.597075:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.597084:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 23 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.597093:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196096:0@lo:104: 00000100:00100000:2.0:1788612462.597143:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612462.597182:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.597191:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 23 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.597199:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196224:0@lo:104: 00000100:00100000:2.0:1788612462.597232:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612462.597257:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.597265:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 23 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.597273:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196352:0@lo:104: 00010000:00010000:2.0:1788612462.597291:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612462.597298:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 23 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.597305:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196480:0@lo:104: 00000100:00100000:2.0:1788612462.597318:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612462.597614:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788612462.597633:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612462.597644:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612462.597652:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196096 00000100:00100000:1.0:1788612462.597657:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196096 00000100:00100000:1.0:1788612462.597689:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196224 00000100:00100000:1.0:1788612462.597697:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196224 00000100:00100000:1.0:1788612462.597707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196352 00000100:00100000:1.0:1788612462.597709:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196352 00000100:00100000:1.0:1788612462.597715:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196480 00000100:00100000:1.0:1788612462.597717:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196480 00000100:00100000:1.0:1788612462.597727:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612462.597734:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:10399:x1875495932196096:12345-0@lo:104: 00010000:00010000:1.0:1788612462.597746:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.597795:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612462.597801:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+6:10399:x1875495932196096:12345-0@lo:104: Request processed in 67us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.597807:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612462.597821:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612462.597826:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ff0c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:10399:x1875495932196224:12345-0@lo:104: 00010000:00010000:1.0:1788612462.597833:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.597858:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612462.597863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ff0c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:10399:x1875495932196224:12345-0@lo:104: Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.597868:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612462.597893:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612462.597898:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:10399:x1875495932196352:12345-0@lo:104: 00010000:00010000:1.0:1788612462.597904:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.597924:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788612462.597933:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:10399:x1875495932196352:12345-0@lo:104: Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.597939:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612462.597948:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612462.597953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:10399:x1875495932196480:12345-0@lo:104: 00010000:00010000:1.0:1788612462.597960:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.597980:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788612462.597984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:10399:x1875495932196480:12345-0@lo:104: Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.597989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788612462.598002:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788612462.598007:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598013:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612462.598017:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598025:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612462.598032:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612462.598038:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612462.598061:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598076:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612462.598096:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598103:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896000/0x1f8616bf0bc7e8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7e93 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598115:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788612462.598118:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598124:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612462.598127:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598134:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612462.598140:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612462.598144:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612462.598154:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598159:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612462.598170:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598176:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc7d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d6d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598189:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612462.598192:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598198:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612462.598201:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598207:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612462.598224:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612462.598229:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612462.598240:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598245:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612462.598250:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598256:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c0030200/0x1f8616bf0bc7d12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598264:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612462.598267:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598281:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612462.598283:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598290:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612462.598296:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612462.598301:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612462.598310:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598316:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612462.598321:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598327:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f5c00/0x1f8616bf0bc7d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc7d0b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598352:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612462.598355:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612462.598356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612462.598363:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612462.598384:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932196736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.598415:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612462.598445:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612462.598450:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932196864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.598513:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612462.598550:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196736 00000100:00100000:1.0:1788612462.598554:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196736 00010000:00010000:1.0:1788612462.598574:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 24 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.598595:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196864 00000100:00100000:1.0:1788612462.598598:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196864 00010000:00010000:1.0:1788612462.598609:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 25 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.598625:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612462.598631:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3650:x1875495932196736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612462.598641:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612462.598645:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 25 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598655:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 25 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598669:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612462.598696:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3650:x1875495932196736:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.598702:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612462.598714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612462.598719:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932196864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612462.598726:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612462.598731:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 24 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598750:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 24 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.598759:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612462.598782:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932196864:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.598789:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612462.598826:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932196864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.598835:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932196736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.598857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932196992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.598880:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612462.598895:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612462.598900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932196608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.598918:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612462.598938:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196992 00000100:00100000:1.0:1788612462.598941:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196992 00010000:00010000:1.0:1788612462.598955:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 24 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.598971:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932196608 00000100:00100000:1.0:1788612462.598973:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932196608 00010000:00010000:1.0:1788612462.598983:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 25 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.598997:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612462.599002:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3648:x1875495932196992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612462.599018:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612462.599023:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 25 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.599031:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 25 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.599040:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612462.599067:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3648:x1875495932196992:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.599073:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612462.599084:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612462.599091:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9287050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932196608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612462.599098:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612462.599102:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 24 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.599109:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 24 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.599117:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612462.599137:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9287050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932196608:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.599143:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612462.599186:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932196608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612462.599194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932196992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612462.599457:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc7e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7e8c expref: 23 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.599471:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196096:0@lo:104: 00010000:00010000:2.0:1788612462.599502:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc7d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7d66 expref: 22 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.599524:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196224:0@lo:104: 00010000:00010000:2.0:1788612462.599536:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc7d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7d12 expref: 21 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.599544:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196352:0@lo:104: 00010000:00010000:2.0:1788612462.599553:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc7d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc7d04 expref: 20 pid: 6517 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612462.599560:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932196480:0@lo:104: 00000100:00100000:3.0:1788612462.609024:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612462.609349:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875495932195968:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612462.609392:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.609546:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313472 00000100:00100000:1.0:1788612462.609565:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313472 00010000:00010000:1.0:1788612462.609597:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.609631:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:1.0:1788612462.609641:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914313472:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612462.609653:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612462.609659:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609670:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609687:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe925000/0x1f8616bf0bc7fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22015 expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609701:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609709:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609724:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609731:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609738:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609755:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609762:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612462.609766:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609774:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609795:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612462.609804:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612462.609922:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612462.609931:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612462.609937:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc806f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612462.610360:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:2395:x1875495914313472:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 718us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612462.610369:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1788612462.687309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612462.687360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612462.687384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612462.687408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612462.687497:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313600 00000100:00100000:3.0:1788612462.687509:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313600 00000100:00100000:3.0:1788612462.687580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313728 00000100:00100000:3.0:1788612462.687584:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313728 00000100:00100000:3.0:1788612462.687610:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612462.687621:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914313600:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612462.687697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914313600:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612462.687705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612462.687723:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1788612462.687743:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914313728:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612462.687768:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914313728:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612462.687775:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00080000:3.0:1788612462.687805:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612462.687809:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612462.695163:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313856 00000100:00100000:0.0:1788612462.695179:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313856 00000100:00100000:0.0:1788612462.695269:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313984 00000100:00100000:0.0:1788612462.695274:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313984 00000100:00100000:0.0:1788612462.695305:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1788612462.695315:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914313856:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612462.695392:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914313856:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612462.695400:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1788612462.695418:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1788612462.695425:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914313984:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612462.695462:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914313984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (8042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612462.695469:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00080000:3.0:1788612462.696433:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612462.696439:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788612462.961105:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612463.063735:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612463.063744:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c67e2000 from 4 10000000:01000000:1.0:1788612463.063749:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612463.063796:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.063807:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.063817:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612463.063855:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.063932:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.063997:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612463.064998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197120 00000100:00100000:3.0:1788612463.065008:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197120 00000100:00100000:3.0:1788612463.065062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788612463.065069:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932197120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612463.065082:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612463.065096:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8076 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.065131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.065141:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.065149:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3800, rc 0) 00000100:00100000:3.0:1788612463.065268:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932197120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.065274:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788612463.073556:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612463.073587:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.073599:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612463.073683:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.073821:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612463.073985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197248 00000100:00100000:0.0:1788612463.073991:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197248 00000100:00100000:0.0:1788612463.074046:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788612463.074056:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932197248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.074197:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612463.075152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932197248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1094us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.075162:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788612463.075345:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.075388:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.075440:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.075561:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.075712:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197376 00000100:00100000:1.0:1788612463.075718:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197376 00000100:00100000:1.0:1788612463.075859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788612463.075878:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932197376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.075985:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932197376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.075992:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788612463.076066:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.077142:0:10412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10412:1875495932197504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612463.077200:0:10412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.077242:0:10412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612463.081800:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197504 00000100:00100000:0.0:1788612463.081831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197504 00000100:00100000:0.0:1788612463.081907:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788612463.081917:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10412:x1875495932197504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612463.082095:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10412:x1875495932197504:12345-0@lo:502:llog_process_th.0 Request processed in 179us (4893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.082103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788612463.083735:0:10412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10412:1875495932197504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612463.083776:0:10412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612463.083788:0:10412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612463.083790:0:10412:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788612463.083798:0:10412:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c67e2000 00000020:00000080:2.0:1788612463.083800:0:10412:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788612463.083902:0:10412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10412:1875495932197632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612463.083960:0:10412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.084008:0:10412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612463.084082:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197632 00000100:00100000:3.0:1788612463.084088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197632 00000100:00100000:3.0:1788612463.084140:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788612463.084149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10412:x1875495932197632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612463.084259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:10412:x1875495932197632:12345-0@lo:502:llog_process_th.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.084267:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788612463.084585:0:10412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10412:1875495932197632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612463.084605:0:10412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612463.084610:0:10412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612463.084611:0:10412:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788612463.084615:0:10412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788612463.086686:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788612463.086720:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612463.086731:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.086743:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612463.086753:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612463.086756:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fcfb4000 from 4 10000000:01000000:3.0:1788612463.086767:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612463.086801:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.086809:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.086820:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612463.086842:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612463.086910:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612463.086951:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67eccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.087113:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197760 00000100:00100000:2.0:1788612463.087120:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197760 00000100:00100000:2.0:1788612463.087165:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788612463.087186:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932197760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612463.087198:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612463.087219:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8084 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.087241:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.087252:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.087261:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1a00, rc 0) 00000100:00100000:2.0:1788612463.087297:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932197760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.087304:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788612463.087646:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612463.087662:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.087670:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612463.087734:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612463.087761:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612463.087783:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67eccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.088314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932197888 00000100:00100000:2.0:1788612463.088320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932197888 00000100:00100000:2.0:1788612463.088368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788612463.088377:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932197888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.088500:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932197888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.088507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788612463.090821:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932197888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612463.091371:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612463.091439:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612463.091493:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67eccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.091618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198016 00000100:00100000:2.0:1788612463.091625:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198016 00000100:00100000:2.0:1788612463.091678:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788612463.091687:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932198016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.092002:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932198016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.092018:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788612463.093563:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.105059:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10414:1875495932198144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.105290:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.105387:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.108807:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198144 00000100:00100000:2.0:1788612463.108821:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198144 00000100:00100000:2.0:1788612463.108884:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788612463.108894:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10414:x1875495932198144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612463.109043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10414:x1875495932198144:12345-0@lo:502:llog_process_th.0 Request processed in 150us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.109050:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788612463.110855:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10414:1875495932198144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612463.110916:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612463.110929:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612463.110932:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612463.110940:0:10414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612fcfb4000 00000020:00000080:1.0:1788612463.110943:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788612463.111044:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10414:1875495932198272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.111117:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.111163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198272 00000100:00100000:1.0:1788612463.111169:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198272 00000100:00100000:1.0:1788612463.111218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788612463.111227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10414:x1875495932198272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.111357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:10414:x1875495932198272:12345-0@lo:502:llog_process_th.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.111364:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788612463.111411:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.111423:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10414:1875495932198272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612463.111440:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612463.111445:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612463.111447:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788612463.111450:0:10414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788612463.112765:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788612463.112800:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612463.112813:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.112825:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612463.112836:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612463.112839:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fccf8000 from 4 10000000:01000000:2.0:1788612463.112842:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612463.112888:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.112897:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.112907:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612463.112931:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.113005:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.113037:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.113061:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198400 00000100:00100000:2.0:1788612463.113066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198400 00000100:00100000:2.0:1788612463.113106:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788612463.113113:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932198400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612463.113295:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612463.113310:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8092 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.113340:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.113351:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.113358:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1800, rc 0) 00000100:00100000:2.0:1788612463.113394:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932198400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.113401:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788612463.113448:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612463.113461:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.113470:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612463.113550:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.113585:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.113599:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.113610:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198528 00000100:00100000:2.0:1788612463.113613:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198528 00000100:00100000:2.0:1788612463.113634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788612463.113640:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932198528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.113734:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932198528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.113741:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788612463.113771:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.113795:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.113834:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.113847:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7966840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.113858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198656 00000100:00100000:2.0:1788612463.113861:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198656 00000100:00100000:2.0:1788612463.114057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788612463.114064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932198656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.114141:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932198656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.114147:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788612463.114183:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932198656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.114814:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10416:1875495932198784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612463.114854:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.114885:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.115098:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198784 00000100:00100000:1.0:1788612463.115105:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198784 00000100:00100000:1.0:1788612463.115151:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788612463.115159:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10416:x1875495932198784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.115266:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10416:x1875495932198784:12345-0@lo:502:llog_process_th.0 Request processed in 107us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.115273:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788612463.115322:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10416:1875495932198784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612463.115360:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612463.115370:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612463.115372:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612463.115379:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612fccf8000 00000020:00000080:1.0:1788612463.115382:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788612463.115449:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10416:1875495932198912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.115503:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.115522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932198912 00000100:00100000:1.0:1788612463.115525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932198912 00000100:00100000:1.0:1788612463.115552:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788612463.115558:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10416:x1875495932198912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.115609:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:10416:x1875495932198912:12345-0@lo:502:llog_process_th.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.115615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788612463.115640:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.115650:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10416:1875495932198912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612463.115665:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612463.115669:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612463.115671:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788612463.115673:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788612463.116621:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788612463.116654:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612463.116664:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.116676:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612463.116685:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612463.116687:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c7237000 from 4 10000000:01000000:2.0:1788612463.116690:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612463.116719:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.116726:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612463.116735:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612463.118313:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932199040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612463.118395:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.119406:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.133720:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199040 00000100:00100000:1.0:1788612463.133734:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199040 00000100:00100000:1.0:1788612463.133804:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788612463.133814:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932199040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612463.133830:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612463.133848:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc80a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.133885:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.133896:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.133905:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5c00, rc 0) 00000100:00100000:1.0:1788612463.133977:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932199040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (15580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.134000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788612463.134064:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932199040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612463.134081:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.134091:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612463.134158:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932199168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.134191:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.134219:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.134231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199168 00000100:00100000:1.0:1788612463.134234:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199168 00000100:00100000:1.0:1788612463.134255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788612463.134261:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932199168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.134368:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932199168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.134376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788612463.134403:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932199168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.134430:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932199296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.134468:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.134509:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612463.134525:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199296 00000100:00100000:1.0:1788612463.134528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199296 00000100:00100000:1.0:1788612463.134569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788612463.134585:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932199296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.134681:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932199296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.134689:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788612463.134741:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932199296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612463.134941:0:10417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10417:1875495932199424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.134977:0:10417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612463.135001:0:10417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612463.135022:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199424 00000100:00100000:2.0:1788612463.135028:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199424 00000100:00100000:2.0:1788612463.135268:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788612463.135278:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:10417:x1875495932199424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612463.135468:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:10417:x1875495932199424:12345-0@lo:502:llog_process_th.0 Request processed in 192us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.135494:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788612463.141174:0:10417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10417:1875495932199424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612463.141230:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612463.141241:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612463.141243:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612463.141250:0:10417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612c7237000 00000020:00000080:1.0:1788612463.141254:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788612463.141367:0:10417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10417:1875495932199552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612463.141432:0:10417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612463.141470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199552 00000100:00100000:1.0:1788612463.141496:0:10417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612463.141502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199552 00000100:00100000:0.0:1788612463.141562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788612463.141574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:10417:x1875495932199552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612463.141703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:10417:x1875495932199552:12345-0@lo:502:llog_process_th.0 Request processed in 130us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.141712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788612463.143188:0:10417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:10417:1875495932199552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612463.143230:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612463.143239:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612463.143241:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788612463.143245:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788612463.143553:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788612463.143595:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612463.143615:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612463.143634:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612463.772030:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612463.772176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314112 00000100:00100000:1.0:1788612463.772189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314112 00000100:00100000:1.0:1788612463.772264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:1.0:1788612463.772276:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:6166:x1875495914314112:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612463.772297:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612463.772323:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2205b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.772373:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.772409:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612463.772421:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5e00, rc 0) 00000100:00100000:1.0:1788612463.772521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914314112:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 247us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612463.772530:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:3.0:1788612463.779601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612463.779738:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314240 00000100:00100000:0.0:1788612463.779751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314240 00000100:00100000:0.0:1788612463.779830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:0.0:1788612463.779842:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914314240:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612463.780047:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914314240:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 207us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.780056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:3.0:1788612463.784130:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612463.784423:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314368 00000100:00100000:0.0:1788612463.784436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314368 00000100:00100000:0.0:1788612463.784542:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 271 00000100:00100000:0.0:1788612463.784556:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914314368:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612463.784757:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6166:x1875495914314368:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 204us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.784889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 271 00000100:00100000:3.0:1788612463.788629:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612463.789052:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314496 00000100:00100000:0.0:1788612463.789066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314496 00000100:00100000:0.0:1788612463.789151:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 272 00000100:00100000:0.0:1788612463.789164:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6699:x1875495914314496:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612463.789358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6699:x1875495914314496:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 197us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.789368:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 272 00000100:00100000:3.0:1788612463.801354:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612463.807305:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314624 00000100:00100000:0.0:1788612463.807336:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314624 00000100:00100000:0.0:1788612463.807427:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:0.0:1788612463.807441:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6699:x1875495914314624:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612463.807682:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:6699:x1875495914314624:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 243us (6354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.807691:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 273 00010000:00010000:1.0:1788612463.990278:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612464.111851:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932199680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612464.111985:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.112083:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199680 00000100:00100000:2.0:1788612464.112094:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199680 00000100:00100000:2.0:1788612464.112189:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612464.112203:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932199680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612464.112241:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612464.112298:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932199680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.112305:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788612464.112343:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612464.112381:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4e300 x1875495932199680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.112403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932199680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612464.114438:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612464.114465:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932199808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612464.114559:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612464.115130:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199808 00000100:00100000:3.0:1788612464.115232:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932199936:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.115249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932200064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.115287:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115296:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115337:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932200576:0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.115340:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932200448:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.115372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612464.115386:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932201088:0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.115414:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932200960:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.115424:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115455:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788612464.115461:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115464:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932200192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.115587:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788612464.115596:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932200320:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.115603:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115628:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932200704:0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.115635:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612464.115662:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932200832:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.115663:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115683:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932201216:0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.115697:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612464.115785:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200448 00000100:00100000:0.0:1788612464.115795:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200448 00000100:00100000:0.0:1788612464.115839:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200192 00000100:00100000:0.0:1788612464.115841:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200192 00000100:00100000:0.0:1788612464.115859:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612464.115891:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932200448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.115968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.115995:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200064 00000100:00100000:2.0:1788612464.115999:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200064 00000100:00100000:2.0:1788612464.116025:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200576 00000100:00100000:2.0:1788612464.116028:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200576 00000100:00100000:2.0:1788612464.116052:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201088 00000100:00100000:2.0:1788612464.116055:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201088 00000100:00100000:2.0:1788612464.116067:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200320 00000100:00100000:2.0:1788612464.116069:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200320 00000100:00100000:2.0:1788612464.116078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200704 00000100:00100000:2.0:1788612464.116081:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200704 00000100:00100000:2.0:1788612464.116093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201216 00000100:00100000:2.0:1788612464.116095:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201216 00000100:00100000:2.0:1788612464.116121:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612464.116128:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116170:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932200064:12345-0@lo:400:kworker.0 Request processed in 42us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.116178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612464.116198:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612464.116204:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932200576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116230:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932200576:12345-0@lo:400:kworker.0 Request processed in 26us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.116237:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612464.116249:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612464.116256:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932201088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116289:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932201088:12345-0@lo:400:kworker.0 Request processed in 33us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612464.116290:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932199936 00000100:00100000:3.0:1788612464.116297:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199936 00000100:00100000:2.0:1788612464.116302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612464.116340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612464.116348:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932200320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.116354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788612464.116366:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932199936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116394:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932200320:12345-0@lo:400:kworker.0 Request processed in 47us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.116401:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788612464.116418:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932199936:12345-0@lo:400:kworker.0 Request processed in 53us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.116419:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612464.116428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932200704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612464.116440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788612464.116463:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932200704:12345-0@lo:400:kworker.0 Request processed in 36us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.116471:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612464.116523:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612464.116531:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932201216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116564:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932201216:12345-0@lo:400:kworker.0 Request processed in 34us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.116571:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788612464.116591:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612464.116596:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612464.116638:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f7800 x1875495932200704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.116654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932200704:0@lo:400:kworker.0 00010000:00080000:2.0:1788612464.116666:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1df80 x1875495932201216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.116675:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932201216:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932200064:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932200576:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116717:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932201088:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116758:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932200320:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.116768:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932199936:0@lo:400:kworker.0 00000100:00100000:1.0:1788612464.118916:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932199808 00000100:00100000:1.0:1788612464.119034:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612464.119046:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932199808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612464.119088:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612464.119589:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932199808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 544us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612464.119598:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788612464.123032:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612464.123127:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ead80 x1875495932199808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.123161:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932199808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612464.127245:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932200448:12345-0@lo:400:kworker.0 Request processed in 11343us (11846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612464.127265:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612464.127316:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788612464.127343:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932200192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612464.127442:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932200192:12345-0@lo:400:kworker.0 Request processed in 117us (11842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612464.127448:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788612464.127515:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200960 00000100:00100000:0.0:1788612464.127524:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200960 00000100:00100000:3.0:1788612464.127543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932200192:0@lo:400:kworker.0 00000100:00100000:0.0:1788612464.127585:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932200832 00000100:00100000:0.0:1788612464.127590:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932200832 00000100:00100000:0.0:1788612464.127622:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612464.127628:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932200960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612464.127666:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932200960:12345-0@lo:400:kworker.0 Request processed in 37us (12205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612464.127673:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612464.127680:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612464.127693:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932200832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788612464.127739:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612464.127756:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932200832:12345-0@lo:400:kworker.0 Request processed in 66us (12059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612464.127763:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788612464.127898:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f6300 x1875495932200832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.127911:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932200832:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.127923:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932200448:0@lo:400:kworker.0 00010000:00080000:2.0:1788612464.127933:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1e300 x1875495932200960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.127942:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932200960:0@lo:400:kworker.0 00000100:00100000:2.0:1788612464.629584:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612464.629620:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932201344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612464.629710:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.629804:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201344 00000100:00100000:2.0:1788612464.629812:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201344 00000100:00100000:2.0:1788612464.629879:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612464.629889:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932201344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612464.629943:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612464.629995:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932201344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.630003:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788612464.630057:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1e300 x1875495932201344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.630080:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932201344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612464.634843:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612464.634878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932201472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612464.634972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612464.635054:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201472 00000100:00100000:1.0:1788612464.635064:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201472 00000100:00100000:1.0:1788612464.635123:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612464.635134:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932201472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612464.635178:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612464.635230:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932201472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612464.635251:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612464.635311:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932201472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612464.635521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612464.635533:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932201600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612464.635571:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612464.635606:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201600 00000100:00100000:2.0:1788612464.635610:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201600 00000100:00100000:2.0:1788612464.635641:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612464.635647:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932201600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612464.635663:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612464.635697:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932201600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612464.635703:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788612464.635734:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1e300 x1875495932201600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612464.635749:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932201600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788612465.013733:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612466.031807:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612467.057013:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612467.699075:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612467.699100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932201728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612467.699174:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612467.699260:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201728 00000100:00100000:2.0:1788612467.699269:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201728 00000100:00100000:2.0:1788612467.699338:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612467.699348:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932201728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612467.699384:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612467.699434:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932201728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612467.699441:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612467.699653:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932201728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612467.802833:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612467.802868:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612467.802895:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612467.802911:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612467.802930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612467.802960:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314880 00000100:00100000:3.0:1788612467.802970:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314880 00000100:00100000:3.0:1788612467.803024:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315008 00000100:00100000:3.0:1788612467.803028:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315008 00000100:00100000:3.0:1788612467.803052:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1788612467.803062:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914314880:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612467.803127:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914314880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612467.803135:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1788612467.803158:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1788612467.803164:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914315008:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612467.803189:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914315008:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612467.803195:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1788612467.803211:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315136 00000100:00100000:3.0:1788612467.803215:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315136 00000100:00100000:3.0:1788612467.803237:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315264 00000100:00100000:3.0:1788612467.803239:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315264 00000100:00100000:3.0:1788612467.803256:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1788612467.803261:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914315136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612467.803285:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914315136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612467.803291:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1788612467.803315:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1788612467.803322:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914315264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612467.803356:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914315264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612467.803361:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00080000:3.0:1788612467.803382:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612467.803386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612467.803389:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612467.803390:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612467.805854:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314752 00000100:00100000:1.0:1788612467.805869:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314752 00000100:00100000:1.0:1788612467.805943:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:1.0:1788612467.805954:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914314752:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612467.806019:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914314752:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612467.806028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 275 00010000:00010000:3.0:1788612468.079777:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612469.103582:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612469.153950:0:10699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788612469.231687:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932202112:0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.231700:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932201984:0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.231765:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.231806:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932201856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612469.231831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.231850:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932202496:0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.231871:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.231888:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932203008:0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.231908:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.231924:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932203520:0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.231942:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.231966:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612469.231971:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932203648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612469.231998:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932202240:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232309:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932202752:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232356:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232374:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932203264:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232420:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612469.232427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932202368:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232461:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232509:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932202880:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232530:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932203392:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232566:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232590:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202496 00000100:00100000:0.0:1788612469.232597:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202496 00000100:00100000:0.0:1788612469.232627:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202240 00000100:00100000:0.0:1788612469.232630:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202240 00000100:00100000:0.0:1788612469.232643:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788612469.232651:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932202496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232700:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932202496:12345-0@lo:400:kworker.0 Request processed in 49us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.232707:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788612469.232724:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612469.232730:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932202240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232762:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932202240:12345-0@lo:400:kworker.0 Request processed in 32us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.232768:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612469.232785:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202752 00000100:00100000:0.0:1788612469.232789:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202752 00000100:00100000:0.0:1788612469.232819:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203264 00000100:00100000:2.0:1788612469.232821:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232822:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203264 00000100:00100000:0.0:1788612469.232833:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202368 00000100:00100000:2.0:1788612469.232835:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932202624:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232836:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202368 00000100:00100000:0.0:1788612469.232845:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202112 00000100:00100000:0.0:1788612469.232853:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202112 00000100:00100000:2.0:1788612469.232854:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612469.232863:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932203136:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.232867:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202624 00000100:00100000:0.0:1788612469.232868:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202624 00000100:00100000:0.0:1788612469.232881:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788612469.232882:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612469.232887:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932202752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.232911:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201856 00000100:00100000:2.0:1788612469.232915:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201856 00000100:00100000:0.0:1788612469.232915:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932202752:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.232920:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612469.232929:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203136 00000100:00100000:0.0:1788612469.232931:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203136 00000100:00100000:2.0:1788612469.232939:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203648 00000100:00100000:2.0:1788612469.232941:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203648 00000100:00100000:0.0:1788612469.232944:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612469.232949:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932203264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.232954:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612469.232959:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932201856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612469.232974:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932203264:12345-0@lo:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00002000:00000024:2.0:1788612469.232978:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612469.232979:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612469.232989:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788612469.232994:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932202368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233007:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932201856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.233013:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612469.233016:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932202368:12345-0@lo:400:kworker.0 Request processed in 22us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.233021:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612469.233025:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612469.233037:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932203648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612469.233046:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00002000:00000024:2.0:1788612469.233047:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612469.233051:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932202112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233072:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932203648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.233077:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612469.233077:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932202112:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.233082:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788612469.233092:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788612469.233094:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203008 00000100:00100000:2.0:1788612469.233097:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203008 00000100:00100000:0.0:1788612469.233097:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932202624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233114:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203520 00000100:00100000:2.0:1788612469.233117:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203520 00000100:00100000:2.0:1788612469.233126:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932202880 00000100:00100000:2.0:1788612469.233127:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932202880 00000100:00100000:2.0:1788612469.233136:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203392 00000100:00100000:2.0:1788612469.233138:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203392 00000100:00100000:2.0:1788612469.233148:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612469.233154:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932203008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233182:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932203008:12345-0@lo:400:kworker.0 Request processed in 28us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.233189:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612469.233201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612469.233206:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932203520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233232:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932203520:12345-0@lo:400:kworker.0 Request processed in 26us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.233237:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612469.233247:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612469.233253:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932202880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233301:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932202880:12345-0@lo:400:kworker.0 Request processed in 39us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612469.233304:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932201984 00000100:00100000:1.0:1788612469.233308:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932201984 00000100:00100000:2.0:1788612469.233315:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612469.233326:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612469.233332:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932203392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.233333:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788612469.233339:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233359:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932203392:12345-0@lo:400:kworker.0 Request processed in 28us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.233365:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612469.233366:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932201984:12345-0@lo:400:kworker.0 Request processed in 27us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612469.233371:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788612469.233413:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932202112:0@lo:400:kworker.0 00010000:00080000:1.0:1788612469.233414:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f5f80 x1875495932203648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612469.233428:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932203648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612469.233437:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932201984:0@lo:400:kworker.0 00010000:00080000:1.0:1788612469.233445:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f9c00 x1875495932201856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612469.233456:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932201856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612469.233467:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932202496:0@lo:400:kworker.0 00010000:00080000:1.0:1788612469.233516:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1fb80 x1875495932203008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612469.233779:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932203008:0@lo:400:kworker.0 00010000:00080000:1.0:1788612469.233793:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4ca80 x1875495932203520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612469.233801:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932203520:0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233830:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788612469.233839:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932203136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233880:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932203136:12345-0@lo:400:kworker.0 Request processed in 43us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.233886:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788612469.233903:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612469.233907:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612469.233909:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612469.233911:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612469.233933:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932202368:0@lo:400:kworker.0 00010000:00080000:2.0:1788612469.233943:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1d180 x1875495932202880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612469.233952:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932202880:0@lo:400:kworker.0 00010000:00080000:2.0:1788612469.233959:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4e300 x1875495932203392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612469.233967:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932203392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.233975:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932202240:0@lo:400:kworker.0 00010000:00080000:2.0:1788612469.233991:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1f480 x1875495932202752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612469.233999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932202752:0@lo:400:kworker.0 00010000:00080000:2.0:1788612469.234007:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4d180 x1875495932203264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612469.234014:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932203264:0@lo:400:kworker.0 00000100:00100000:2.0:1788612469.234042:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932203136:0@lo:400:kworker.0 00000100:00100000:0.0:1788612469.234740:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932202624:12345-0@lo:400:kworker.0 Request processed in 1641us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.234747:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788612469.234771:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932202624:0@lo:400:kworker.0 00000100:00100000:1.0:1788612469.746973:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932203904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612469.747068:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.747129:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612469.747136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932203776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612469.747160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612469.748446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932204032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612469.748521:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612469.748641:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203904 00000100:00100000:2.0:1788612469.748649:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203904 00000100:00100000:2.0:1788612469.748698:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932203776 00000100:00100000:2.0:1788612469.748701:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932203776 00000100:00100000:2.0:1788612469.748716:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612469.748723:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932203904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612469.748752:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612469.748802:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932203904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.748808:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612469.748825:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612469.748831:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932203776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612469.748840:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612469.748860:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932203776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612469.748865:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788612469.748899:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76f7800 x1875495932203776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612469.748929:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932203776:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788612469.748941:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79faa00 x1875495932203904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612469.748951:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932203904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612469.751527:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204032 00000100:00100000:0.0:1788612469.751541:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204032 00000100:00100000:0.0:1788612469.751614:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788612469.751624:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932204032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612469.751659:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612469.751745:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932204032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (3223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612469.751753:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612469.751868:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932204032:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612470.127766:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612471.152381:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612472.178223:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612472.815609:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932204160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612472.815682:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612472.816111:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204160 00000100:00100000:2.0:1788612472.816120:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204160 00000100:00100000:2.0:1788612472.816210:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612472.816220:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932204160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612472.816251:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612472.816315:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932204160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612472.816322:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612472.820161:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932204160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612472.922891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612472.922930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612472.922952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612472.922970:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612472.923028:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612472.923054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315520 00000100:00100000:0.0:1788612472.923063:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315520 00000100:00100000:0.0:1788612472.923116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315648 00000100:00100000:0.0:1788612472.923119:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315648 00000100:00100000:0.0:1788612472.923154:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1788612472.923163:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914315520:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612472.923223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914315520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 61us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612472.923240:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1788612472.923259:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:0.0:1788612472.923276:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914315648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612472.923305:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914315648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612472.923311:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:0.0:1788612472.923333:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315904 00000100:00100000:0.0:1788612472.923337:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315904 00000100:00100000:0.0:1788612472.923361:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315776 00000100:00100000:0.0:1788612472.923364:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315776 00000100:00100000:0.0:1788612472.923384:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1788612472.923390:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914315904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612472.923416:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914315904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612472.923422:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1788612472.923433:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1788612472.923440:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914315776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612472.923796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315392 00000100:00100000:3.0:1788612472.923801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315392 00000100:00100000:3.0:1788612472.923833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:3.0:1788612472.923840:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914315392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612472.925321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914315392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1473us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612472.925335:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00080000:1.0:1788612472.926585:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612472.926595:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612472.926599:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612472.926602:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612472.926611:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914315776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3166us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612472.926626:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00010000:00010000:3.0:1788612473.199700:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612474.078399:0:10941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing yml_node 00010000:00010000:0.0:1788612474.228253:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612474.351688:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612474.351710:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932204288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612474.351995:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612474.352006:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932204416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612474.357742:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612474.358170:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204416 00000100:00100000:2.0:1788612474.358180:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204416 00000100:00100000:2.0:1788612474.358244:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612474.358267:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932204416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612474.358301:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612474.358356:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932204416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612474.358376:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788612474.358423:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79fad80 x1875495932204416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612474.358443:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932204416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612474.359457:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612474.359635:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612474.359716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932204544:0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.359885:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.359910:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932205056:0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.359934:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.359953:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932205568:0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.359990:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.360016:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612474.360023:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932204672:0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.360050:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.360234:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932205184:0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.360288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.360353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932205696:0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.360380:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612474.360387:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204288 00000100:00100000:3.0:1788612474.360400:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204288 00000100:00100000:3.0:1788612474.360465:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788612474.360605:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932204288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612474.360631:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612474.360753:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932204288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612474.360761:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612474.373334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204544 00000100:00100000:1.0:1788612474.373348:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204544 00000100:00100000:1.0:1788612474.373398:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788612474.373408:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932204544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.373510:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932204544:12345-0@lo:400:kworker.0 Request processed in 104us (13624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612474.373518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788612474.373551:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205056 00000100:00100000:1.0:1788612474.373555:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205056 00000100:00100000:1.0:1788612474.373584:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612474.373590:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932205056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.373625:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932205056:12345-0@lo:400:kworker.0 Request processed in 35us (13690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612474.373631:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612474.373664:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205568 00000100:00100000:1.0:1788612474.373668:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205568 00000100:00100000:1.0:1788612474.373697:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788612474.373704:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932205568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612474.373869:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932205568:12345-0@lo:400:kworker.0 Request processed in 165us (13877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612474.373876:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612474.373952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204672 00000100:00100000:0.0:1788612474.373957:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204672 00000100:00100000:0.0:1788612474.373995:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205184 00000100:00100000:0.0:1788612474.373998:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205184 00000100:00100000:0.0:1788612474.374027:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205696 00000100:00100000:0.0:1788612474.374029:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205696 00000100:00100000:0.0:1788612474.374045:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612474.374052:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932204672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.374109:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932204672:12345-0@lo:400:kworker.0 Request processed in 57us (14057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612474.374117:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612474.374136:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612474.374143:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.374179:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932205184:12345-0@lo:400:kworker.0 Request processed in 37us (13890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612474.374185:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612474.374198:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612474.374205:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932205696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.374237:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932205696:12345-0@lo:400:kworker.0 Request processed in 33us (13858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612474.374243:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788612474.376361:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932204800:0@lo:400:kworker.0 00000100:00080000:0.0:1788612474.376643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612474.376649:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612474.376652:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612474.376684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932204928:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.376717:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612474.376747:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932205440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.376767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788612474.376992:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f5880 x1875495932204288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612474.377034:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932204288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612474.377073:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204928 00000100:00100000:0.0:1788612474.377080:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204928 00000100:00100000:0.0:1788612474.377118:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612474.377220:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932204928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.377283:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932204928:12345-0@lo:400:kworker.0 Request processed in 157us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612474.377290:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612474.377320:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932204928:0@lo:400:kworker.0 00000100:00100000:2.0:1788612474.377386:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612474.377740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932205312:0@lo:400:kworker.0 00000100:00100000:2.0:1788612474.377956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612474.377977:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932205824:0@lo:400:kworker.0 00000100:00100000:2.0:1788612474.378000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612474.378193:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205312 00000100:00100000:3.0:1788612474.378198:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205312 00000100:00100000:3.0:1788612474.378238:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205824 00000100:00100000:3.0:1788612474.378241:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205824 00000100:00100000:3.0:1788612474.378272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788612474.378280:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932205312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612474.378326:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932205312:12345-0@lo:400:kworker.0 Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612474.378333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788612474.378348:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612474.378354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612474.378403:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932205824:12345-0@lo:400:kworker.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612474.378409:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788612474.378425:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788612474.378463:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4d180 x1875495932205312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612474.378585:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932204800 00000100:00100000:0.0:1788612474.378590:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932204800 00000100:00100000:0.0:1788612474.378622:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788612474.378628:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932204800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.378753:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932204800:12345-0@lo:400:kworker.0 Request processed in 125us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612474.378760:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788612474.379357:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932205312:0@lo:400:kworker.0 00010000:00080000:3.0:1788612474.379380:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed1180 x1875495932205824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612474.379391:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932205824:0@lo:400:kworker.0 00000100:00100000:3.0:1788612474.379420:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932204800:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.379635:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205440 00000100:00100000:0.0:1788612474.379640:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205440 00000100:00100000:0.0:1788612474.379959:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612474.379967:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932205440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.380037:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932205440:12345-0@lo:400:kworker.0 Request processed in 70us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612474.380044:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612474.380077:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932204672:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.380099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932205184:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.380113:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932205696:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.380137:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932204544:0@lo:400:kworker.0 00000100:00100000:0.0:1788612474.380150:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932205056:0@lo:400:kworker.0 00010000:00080000:0.0:1788612474.380161:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4ca80 x1875495932205568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612474.380170:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932205568:0@lo:400:kworker.0 00010000:00080000:0.0:1788612474.380215:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4e300 x1875495932205440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612474.380223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932205440:0@lo:400:kworker.0 00000100:00080000:3.0:1788612474.384986:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612474.863710:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612474.863732:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932205952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612474.863795:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612474.863851:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932205952 00000100:00100000:3.0:1788612474.863858:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932205952 00000100:00100000:3.0:1788612474.863898:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612474.863906:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932205952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612474.863931:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612474.863970:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932205952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612474.863977:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788612474.864015:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880a80 x1875495932205952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612474.864044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932205952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612474.865029:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932206080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612474.865090:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.866376:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612474.866388:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932206208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612474.866543:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612474.866600:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206080 00000100:00100000:1.0:1788612474.866607:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206080 00000100:00100000:1.0:1788612474.868027:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612474.868042:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932206080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612474.868082:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612474.868164:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932206080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612474.868172:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612474.868208:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206208 00000100:00100000:1.0:1788612474.868213:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206208 00000100:00100000:1.0:1788612474.868248:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788612474.868267:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932206208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612474.868292:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612474.868324:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932206208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612474.868331:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612474.868800:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932206208:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788612474.868814:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1d180 x1875495932206080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612474.868827:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932206080:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788612475.248697:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612476.271725:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612477.297594:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612477.937698:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932206336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612477.937815:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612477.937973:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206336 00000100:00100000:2.0:1788612477.937984:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206336 00000100:00100000:2.0:1788612477.938068:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788612477.938080:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932206336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612477.938133:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612477.938194:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932206336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612477.938220:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788612477.938510:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932206336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612478.049403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612478.049449:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612478.049494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612478.049521:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612478.049550:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612478.049584:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316288 00000100:00100000:1.0:1788612478.049597:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316288 00000100:00100000:1.0:1788612478.049741:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316160 00000100:00100000:1.0:1788612478.049746:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316160 00000100:00100000:1.0:1788612478.049785:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788612478.049797:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914316288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612478.049954:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914316288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 160us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612478.049963:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788612478.049983:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:1.0:1788612478.049990:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914316160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612478.050021:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914316160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612478.050029:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1788612478.050063:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316032 00000100:00100000:1.0:1788612478.050065:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316416 00000100:00100000:3.0:1788612478.050070:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316032 00000100:00100000:1.0:1788612478.050072:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316416 00000100:00100000:3.0:1788612478.050121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:3.0:1788612478.050129:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914316032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612478.050162:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2395:x1875495914316032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612478.050169:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00080000:3.0:1788612478.050199:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612478.050204:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612478.050206:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612478.050331:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316544 00000100:00100000:1.0:1788612478.050336:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316544 00000100:00100000:1.0:1788612478.050381:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1788612478.050388:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2393:x1875495914316416:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:1.0:1788612478.050417:0:8543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7fc0 00000100:00080000:1.0:1788612478.050429:0:8543:0:(import.c:65:import_set_state_nolock()) ffff9611c7932000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788612478.050447:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1788612478.050458:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2393:x1875495914316544:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:3.0:1788612478.050504:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7fc7 00000100:00080000:3.0:1788612478.050512:0:8439:0:(import.c:65:import_set_state_nolock()) ffff961300763800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612478.050525:0:8543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:3.0:1788612478.050552:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:2.0:1788612478.050901:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788612478.050928:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612478.050957:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+2:2393:x1875495914316416:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 431us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612478.050965:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:3.0:1788612478.051260:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+2:2393:x1875495914316544:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 803us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612478.051267:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00010000:00010000:1.0:1788612478.053575:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612478.322254:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612478.454781:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:1.0:1788612479.345524:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612479.473662:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932206464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612479.473764:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612479.473875:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206464 00000100:00100000:0.0:1788612479.473887:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206464 00000100:00100000:0.0:1788612479.474190:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788612479.474207:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932206464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612479.474255:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612479.474316:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932206464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612479.474325:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612479.474350:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932206592:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788612479.474384:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f9180 x1875495932206464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612479.474392:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612479.474418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932206464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612479.474505:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206592 00000100:00100000:3.0:1788612479.474511:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206592 00000100:00100000:3.0:1788612479.474540:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612479.474547:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932206592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612479.474559:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612479.474590:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932206592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612479.474595:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788612479.474618:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed3100 x1875495932206592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612479.474630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932206592:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788612479.476785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612479.476809:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932206848:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.476886:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.476927:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932207360:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.476949:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.476982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932207872:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.477005:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.477313:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788612479.477320:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932206976:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.477350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.477509:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932207488:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.477532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612479.477580:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206976 00000100:00100000:3.0:1788612479.477590:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206976 00000100:00100000:3.0:1788612479.477642:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612479.477652:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.477712:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932206976:12345-0@lo:400:kworker.0 Request processed in 61us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612479.477720:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612479.478566:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932206720:0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.478611:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612479.478647:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932207232:0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.478668:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612479.478684:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932207744:0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.478708:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612479.478731:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788612479.478737:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932207104:0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.478783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206720 00000100:00100000:3.0:1788612479.478788:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206720 00000100:00100000:3.0:1788612479.478824:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788612479.478832:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932206720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.478873:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932206720:12345-0@lo:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612479.478880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788612479.478912:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207744 00000100:00100000:3.0:1788612479.478916:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207744 00000100:00100000:3.0:1788612479.478953:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612479.478959:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932207744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.478988:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932207744:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612479.478994:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788612479.479015:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612479.479030:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207232 00000100:00100000:3.0:1788612479.479034:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207232 00000100:00100000:3.0:1788612479.479057:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788612479.479063:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932207232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.479095:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932207232:12345-0@lo:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612479.479101:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788612479.489357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932208000:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.489438:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612479.492265:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932206848 00000100:00100000:0.0:1788612479.492283:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932206848 00000100:00100000:2.0:1788612479.492373:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932206976:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.492416:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207360 00000100:00100000:2.0:1788612479.492420:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207360 00000100:00100000:2.0:1788612479.492528:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207872 00000100:00100000:2.0:1788612479.492532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207872 00000100:00100000:2.0:1788612479.492548:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207488 00000100:00100000:2.0:1788612479.492551:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207488 00000100:00100000:2.0:1788612479.492564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208000 00000100:00100000:2.0:1788612479.492575:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208000 00000100:00100000:2.0:1788612479.492596:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612479.492605:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932207360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.492692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932207360:12345-0@lo:400:kworker.0 Request processed in 87us (15741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.492700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612479.492721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788612479.492728:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932207872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.492758:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932207872:12345-0@lo:400:kworker.0 Request processed in 31us (15753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.492765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788612479.492776:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788612479.492781:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932207488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.492807:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932207488:12345-0@lo:400:kworker.0 Request processed in 26us (15274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.492813:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788612479.492823:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612479.492829:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932208000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.492854:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932208000:12345-0@lo:400:kworker.0 Request processed in 26us (3417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.492860:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612479.492879:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.492910:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932207616:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.492947:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.492977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932206720:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.493004:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932207232:0@lo:400:kworker.0 00010000:00080000:2.0:1788612479.493021:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7adea00 x1875495932207744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612479.493033:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932207744:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.493059:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207104 00000100:00100000:2.0:1788612479.493063:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207104 00000100:00080000:0.0:1788612479.493065:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612479.493072:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612479.493086:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788612479.493093:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932207104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612479.493352:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788612479.493359:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932206848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612479.493403:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932206848:12345-0@lo:400:kworker.0 Request processed in 44us (16518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612479.493410:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788612479.493504:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932207104:12345-0@lo:400:kworker.0 Request processed in 411us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.493511:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788612479.493561:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7adca80 x1875495932207488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612479.493572:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932207488:0@lo:400:kworker.0 00010000:00080000:2.0:1788612479.493583:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7add500 x1875495932208000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612479.493591:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932208000:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.493603:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932206848:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.493613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932207360:0@lo:400:kworker.0 00000100:00100000:2.0:1788612479.493621:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932207872:0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.496762:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932207616 00000100:00100000:3.0:1788612479.496782:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932207616 00000100:00100000:3.0:1788612479.496906:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612479.496917:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932207616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612479.497021:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932207616:12345-0@lo:400:kworker.0 Request processed in 106us (4072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612479.497037:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788612479.498337:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612479.502339:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932207104:0@lo:400:kworker.0 00010000:00080000:1.0:1788612479.502910:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7adc000 x1875495932207616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612479.502924:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932207616:0@lo:400:kworker.0 00000100:00100000:0.0:1788612479.983778:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932208128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612479.983881:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612479.984254:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208128 00000100:00100000:1.0:1788612479.984265:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208128 00000100:00100000:1.0:1788612479.984338:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612479.984349:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932208128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612479.984392:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612479.987894:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932208256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612479.987897:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612479.987916:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932208384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612479.988803:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.988929:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208256 00000100:00100000:2.0:1788612479.988997:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208256 00000100:00100000:2.0:1788612479.989068:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612479.989078:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932208256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612479.989124:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612479.989176:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932208256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.989183:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612479.989255:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932208256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612479.989749:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932208128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5392us (5858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612479.989765:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788612479.991271:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612479.991635:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208384 00000100:00100000:1.0:1788612479.991649:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208384 00000100:00100000:1.0:1788612479.991723:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612479.991735:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932208384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612479.991767:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612479.991853:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932208384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612479.991862:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788612479.992353:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4f100 x1875495932208384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612479.992384:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932208384:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788612479.992650:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4ca80 x1875495932208128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612479.992668:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932208128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788612480.367729:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612481.155897:0:11223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:1.0:1788612481.394271:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612482.416313:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612483.057606:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932208512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612483.057755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.057826:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208512 00000100:00100000:2.0:1788612483.057917:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208512 00000100:00100000:2.0:1788612483.058103:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612483.058116:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932208512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612483.058335:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612483.058389:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932208512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 277us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.058398:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612483.058450:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932208512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612483.159925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612483.160031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612483.160079:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612483.160133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316672 00000100:00100000:3.0:1788612483.160143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316672 00000100:00100000:3.0:1788612483.160213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:3.0:1788612483.160224:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914316672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612483.160293:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914316672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612483.160301:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:1.0:1788612483.162495:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316800 00000100:00100000:1.0:1788612483.162519:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316800 00000100:00100000:3.0:1788612483.162606:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316928 00000100:00100000:3.0:1788612483.162611:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316928 00000100:00080000:0.0:1788612483.162690:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612483.162694:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612483.162716:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1788612483.162727:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914316800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612483.162857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:2.0:1788612483.162868:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914316928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612483.162934:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914316928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.162941:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:3.0:1788612483.163003:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914316800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 278us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612483.163011:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000001:02000400:1.0:1788612483.345296:0:11321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:1.0:1788612483.440825:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788612483.579585:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:3.0:1788612483.579594:0:8434:0:(genops.c:885:class_export_put()) final put ffff9611c7930800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:0.0:1788612483.579747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7930800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-OST0000 00000020:00000080:0.0:1788612483.579790:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7932000 for lustre-OST0000 00000001:00100000:3.0:1788612483.593271:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:3.0:1788612483.593283:0:9518:0:(genops.c:885:class_export_put()) final put ffff961301688800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:0.0:1788612483.593371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961301688800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-OST0001 00000020:00000080:0.0:1788612483.593441:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961300763800 for lustre-OST0001 00010000:00010000:3.0:1788612484.464754:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612484.600350:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612484.600372:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932208640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612484.600440:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.600532:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208640 00000100:00100000:1.0:1788612484.600539:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208640 00000100:00100000:1.0:1788612484.600594:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612484.600603:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932208640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612484.600628:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612484.600676:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932208640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.600685:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788612484.600792:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7ad4000 x1875495932208640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612484.600814:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932208640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612484.600962:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932208896:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.600992:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601011:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932209408:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601030:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932209920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601065:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601083:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788612484.601089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932209024:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601111:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601138:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932209536:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932210048:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601206:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601230:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208896 00000100:00100000:1.0:1788612484.601235:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208896 00000100:00100000:1.0:1788612484.601258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209408 00000100:00100000:1.0:1788612484.601261:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209408 00000100:00100000:1.0:1788612484.601276:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209920 00000100:00100000:1.0:1788612484.601278:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209920 00000100:00100000:1.0:1788612484.601290:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209536 00000100:00100000:1.0:1788612484.601292:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209536 00000100:00100000:1.0:1788612484.601302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210048 00000100:00100000:1.0:1788612484.601304:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210048 00000100:00100000:1.0:1788612484.601316:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788612484.601322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932208896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601358:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932208896:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.601365:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788612484.601378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788612484.601383:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932209408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601407:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932209408:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.601413:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788612484.601423:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788612484.601428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932209920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601452:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932209920:12345-0@lo:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.601467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788612484.601504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788612484.601511:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932209536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601538:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932209536:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.601543:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788612484.601553:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788612484.601559:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932210048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601585:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932210048:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.601590:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788612484.601611:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209024 00000100:00100000:1.0:1788612484.601615:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209024 00000100:00100000:1.0:1788612484.601640:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612484.601645:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932209024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601675:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932209024:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.601681:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612484.601704:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932209152:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601727:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601745:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932209664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601767:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601784:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932210176:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601802:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601830:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612484.601836:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932208768:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601860:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601884:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932209280:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601918:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932209792:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.601939:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.601963:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209664 00000100:00100000:1.0:1788612484.601967:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209664 00000100:00100000:1.0:1788612484.601995:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210176 00000100:00100000:1.0:1788612484.601997:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210176 00000100:00100000:1.0:1788612484.602008:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209792 00000100:00100000:1.0:1788612484.602010:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209792 00000100:00100000:1.0:1788612484.602021:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612484.602027:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fee33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932209664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602061:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fee33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932209664:12345-0@lo:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.602067:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612484.602222:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612484.602229:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932210176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602259:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932210176:12345-0@lo:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.602265:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612484.602276:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612484.602281:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932209792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602304:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932209792:12345-0@lo:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.602319:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612484.602340:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932208768 00000100:00100000:1.0:1788612484.602344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932208768 00000100:00100000:1.0:1788612484.602369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788612484.602375:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932208768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602403:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932208768:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.602408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788612484.602434:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209280 00000100:00100000:1.0:1788612484.602438:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209280 00000100:00100000:1.0:1788612484.602457:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612484.602462:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932209280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602511:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932209280:12345-0@lo:400:kworker.0 Request processed in 49us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.602517:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612484.602557:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932209024:0@lo:400:kworker.0 00010000:00080000:1.0:1788612484.602571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7ad5180 x1875495932209536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612484.602581:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932209536:0@lo:400:kworker.0 00010000:00080000:1.0:1788612484.602592:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7840000 x1875495932210048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612484.602600:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932210048:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602612:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932208896:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602621:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932209408:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602642:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932209920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602673:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932208768:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602682:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932209280:0@lo:400:kworker.0 00010000:00080000:1.0:1788612484.602693:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7840e00 x1875495932209792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612484.602702:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932209792:0@lo:400:kworker.0 00010000:00080000:1.0:1788612484.602712:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7843100 x1875495932209664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612484.602720:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932209664:0@lo:400:kworker.0 00010000:00080000:1.0:1788612484.602729:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7842a00 x1875495932210176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612484.602735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932210176:0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602755:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932209152 00000100:00100000:1.0:1788612484.602759:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932209152 00000100:00100000:1.0:1788612484.602783:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788612484.602789:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932209152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612484.602820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932209152:12345-0@lo:400:kworker.0 Request processed in 32us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.602825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788612484.602848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932209152:0@lo:400:kworker.0 00000100:00080000:1.0:1788612484.602876:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612484.602879:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612484.602886:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612484.602888:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612484.606337:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932210304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612484.606406:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612484.606712:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210304 00000100:00100000:1.0:1788612484.606719:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210304 00000100:00100000:1.0:1788612484.607063:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612484.607079:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932210304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788612484.607100:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612484.607622:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932210304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 545us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612484.607631:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788612484.607728:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7addc00 x1875495932210304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612484.607745:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932210304:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788612484.742285:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 08:48:03 EDT 2026 00000100:00100000:1.0:1788612485.104587:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932210432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612485.104664:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612485.104777:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210432 00000100:00100000:0.0:1788612485.104785:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210432 00000100:00100000:0.0:1788612485.104857:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788612485.104866:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932210432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612485.104896:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612485.104944:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932210432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612485.104951:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788612485.104988:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4dc00 x1875495932210432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612485.105019:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932210432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612485.105068:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612485.105080:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932210560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612485.105112:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612485.105576:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612485.105578:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210560 00000100:00100000:0.0:1788612485.105584:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210560 00000100:00100000:1.0:1788612485.105588:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932210688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612485.105623:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612485.105629:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788612485.105640:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932210560:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612485.105663:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210688 00000100:00100000:1.0:1788612485.105667:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210688 00000004:00000024:0.0:1788612485.105667:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612485.105696:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612485.105705:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932210688:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612485.105713:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932210560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (598us total) trans 0 rc 0/0 00002000:00000024:1.0:1788612485.105718:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612485.105723:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612485.105753:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932210688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612485.105761:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788612485.105778:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4ea00 x1875495932210688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612485.105793:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932210688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612485.106378:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932210560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788612485.497043:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612486.512084:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612487.535664:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612488.176041:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612488.176076:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932210816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612488.176139:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612488.177067:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210816 00000100:00100000:0.0:1788612488.177079:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210816 00000100:00100000:0.0:1788612488.177139:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788612488.177149:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932210816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612488.177215:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612488.177304:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932210816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612488.177311:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788612488.177526:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932210816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612488.280156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612488.280213:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612488.280248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612488.280291:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317056 00000100:00100000:1.0:1788612488.280301:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317056 00000100:00100000:1.0:1788612488.280359:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:1.0:1788612488.280369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2394:x1875495914317056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612488.280432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2394:x1875495914317056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612488.280440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:0.0:1788612488.280499:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317312 00000100:00100000:0.0:1788612488.280504:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317312 00000100:00100000:2.0:1788612488.280532:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317184 00000100:00100000:2.0:1788612488.280536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317184 00000100:00100000:2.0:1788612488.280569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1788612488.280577:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914317184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612488.280616:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914317184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612488.280623:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00080000:1.0:1788612488.280634:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612488.280638:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612488.280692:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:0.0:1788612488.280700:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914317312:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612488.280729:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914317312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612488.280965:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00010000:00010000:2.0:1788612488.561005:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612489.583695:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612489.712943:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932211200:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713003:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.713043:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612ea239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932211712:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.713086:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932212224:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.713132:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612489.713138:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932211328:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713171:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.713192:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932211840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713213:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.713231:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932212352:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.713285:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211712 00000100:00100000:1.0:1788612489.713291:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211712 00000100:00100000:1.0:1788612489.713341:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212224 00000100:00100000:1.0:1788612489.713350:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212224 00000100:00100000:1.0:1788612489.713368:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211328 00000100:00100000:1.0:1788612489.713370:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211328 00000100:00100000:1.0:1788612489.713384:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612489.713391:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932211712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713439:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932211712:12345-0@lo:400:kworker.0 Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.713446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612489.713461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788612489.713467:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932212224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713515:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932212224:12345-0@lo:400:kworker.0 Request processed in 49us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.713521:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788612489.713532:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612489.713537:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932211328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713561:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932211328:12345-0@lo:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.713567:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612489.713587:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211840 00000100:00100000:1.0:1788612489.713591:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211840 00000100:00100000:1.0:1788612489.713613:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212352 00000100:00100000:1.0:1788612489.713616:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212352 00000100:00100000:1.0:1788612489.713632:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612489.713638:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932211840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713668:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932211840:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.713674:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612489.713692:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612489.713697:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932212352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.713721:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932212352:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.713726:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788612489.713742:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612489.713745:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612489.713747:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612489.713775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932211328:0@lo:400:kworker.0 00010000:00080000:1.0:1788612489.713786:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc6d80 x1875495932211840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612489.713796:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932211840:0@lo:400:kworker.0 00010000:00080000:1.0:1788612489.713803:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7865180 x1875495932212352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612489.713810:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932212352:0@lo:400:kworker.0 00010000:00080000:1.0:1788612489.713818:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612ea239180 x1875495932211712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612489.713826:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612ea239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932211712:0@lo:400:kworker.0 00010000:00080000:1.0:1788612489.713835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed3480 x1875495932212224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612489.713842:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932212224:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714220:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932211072:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714252:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714269:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932211584:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714286:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714297:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932212096:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714316:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714329:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788612489.714335:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932210944:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714357:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714377:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932211456:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714399:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714418:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932211968:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714439:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714452:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932212480:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714507:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.714530:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211200 00000100:00100000:0.0:1788612489.714534:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211200 00000100:00100000:0.0:1788612489.714560:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211456 00000100:00100000:0.0:1788612489.714567:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211456 00000100:00100000:0.0:1788612489.714608:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612489.714615:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932211200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714654:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932211200:12345-0@lo:400:kworker.0 Request processed in 39us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612489.714660:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612489.714675:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612489.714681:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932211456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.714711:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932211456:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612489.714720:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612489.714790:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612489.714799:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932212608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612489.714825:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612489.714853:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211072 00000100:00100000:2.0:1788612489.714857:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211072 00000100:00100000:0.0:1788612489.714949:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211584 00000100:00100000:0.0:1788612489.714952:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211584 00000100:00100000:0.0:1788612489.714972:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212096 00000100:00100000:0.0:1788612489.714975:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212096 00000100:00100000:0.0:1788612489.714987:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788612489.714992:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932211584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.715021:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932211584:12345-0@lo:400:kworker.0 Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612489.715026:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788612489.715037:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788612489.715043:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932212096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.715068:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932212096:12345-0@lo:400:kworker.0 Request processed in 26us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612489.715081:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788612489.715123:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932211456:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.715135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932211584:0@lo:400:kworker.0 00000100:00100000:0.0:1788612489.715143:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932212096:0@lo:400:kworker.0 00000100:00100000:2.0:1788612489.715522:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612489.715529:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932211072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612489.715578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932211072:12345-0@lo:400:kworker.0 Request processed in 50us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612489.715586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612489.715605:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212608 00000100:00100000:2.0:1788612489.715609:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212608 00000100:00100000:2.0:1788612489.715637:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612489.715643:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932212608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612489.715664:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612489.715702:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932212608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612489.715710:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788612489.715800:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7adf800 x1875495932212608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612489.715817:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932212608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612489.716383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932210944 00000100:00100000:1.0:1788612489.716389:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932210944 00000100:00100000:1.0:1788612489.716420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788612489.716460:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612489.716470:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932212736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612489.716523:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932210944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.716561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932210944:12345-0@lo:400:kworker.0 Request processed in 128us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.716567:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788612489.716602:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932211968 00000100:00100000:1.0:1788612489.716606:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932211968 00000100:00100000:1.0:1788612489.716630:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212480 00000100:00100000:1.0:1788612489.716633:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212480 00000100:00100000:1.0:1788612489.716649:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612489.716655:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932211968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.716686:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932211968:12345-0@lo:400:kworker.0 Request processed in 32us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.716692:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612489.717137:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612489.717223:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612489.717230:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932212480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.717265:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932212480:12345-0@lo:400:kworker.0 Request processed in 37us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.717272:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612489.717286:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212736 00000100:00100000:1.0:1788612489.717291:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212736 00000100:00100000:2.0:1788612489.717424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932210944:0@lo:400:kworker.0 00010000:00080000:2.0:1788612489.717441:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4e00 x1875495932211968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612489.717451:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932211968:0@lo:400:kworker.0 00010000:00080000:2.0:1788612489.717461:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7867b80 x1875495932212480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612489.717469:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932212480:0@lo:400:kworker.0 00000100:00100000:2.0:1788612489.717500:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932211072:0@lo:400:kworker.0 00000100:00100000:1.0:1788612489.717567:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788612489.717575:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932212736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788612489.717591:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612489.717637:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932212736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.717643:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788612489.719425:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692e300 x1875495932212736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612489.719456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932212736:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788612489.719886:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612489.719901:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612489.720239:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612489.720271:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932211200:0@lo:400:kworker.0 00000100:00100000:2.0:1788612490.223603:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932212864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612490.223678:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612490.223754:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932212992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612490.223768:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212864 00000100:00100000:0.0:1788612490.223776:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212864 00000100:00100000:2.0:1788612490.223786:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612490.223821:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612490.223823:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788612490.223827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932213120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612490.223832:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932212864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612490.223848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788612490.223864:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612490.223915:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932212992 00000100:00100000:1.0:1788612490.223920:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932212992 00000100:00100000:0.0:1788612490.223921:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932212864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612490.223928:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788612490.223958:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213120 00000100:00100000:1.0:1788612490.223961:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213120 00000100:00100000:0.0:1788612490.223966:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788612490.223973:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932212992:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612490.223975:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788612490.223980:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932213120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612490.223991:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788612490.223991:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612490.224022:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932212992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612490.224029:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788612490.224030:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932213120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612490.224035:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788612490.224189:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692d880 x1875495932213120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612490.224213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932213120:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788612490.224226:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f7480 x1875495932212992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612490.224237:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932212992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612490.224269:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932212864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788612490.614644:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612491.634942:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612492.658334:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612493.295808:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932213248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612493.295898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612493.296040:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213248 00000100:00100000:2.0:1788612493.296048:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213248 00000100:00100000:2.0:1788612493.296101:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788612493.296111:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932213248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612493.296152:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612493.299940:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932213248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3819us (4030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.299971:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788612493.303502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932213248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612493.399771:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612493.399832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612493.399859:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317568 00000100:00100000:0.0:1788612493.399870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612493.399880:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317568 00000100:00100000:0.0:1788612493.399896:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317696 00000100:00100000:0.0:1788612493.399902:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317696 00000100:00100000:1.0:1788612493.399945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317440 00000100:00100000:1.0:1788612493.399949:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317440 00000100:00100000:1.0:1788612493.399993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:1.0:1788612493.400003:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914317440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612493.400049:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:2.0:1788612493.400059:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914317568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612493.400074:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914317440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612493.400083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:2.0:1788612493.400097:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914317568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.400107:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00080000:2.0:1788612493.400210:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612493.400214:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612493.400236:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:0.0:1788612493.400246:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914317696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612493.400277:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914317696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612493.400284:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 109 00010000:00010000:0.0:1788612493.679944:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612494.711359:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612494.833013:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833079:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612494.833206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932213504:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.833238:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612494.833336:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932213376:0@lo:400:kworker.0 00000100:00100000:2.0:1788612494.833372:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612494.833443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932214272:0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833471:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612494.833519:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932214784:0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833542:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612494.833584:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213760 00000100:00100000:1.0:1788612494.833592:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213760 00000100:00100000:1.0:1788612494.833631:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213504 00000100:00100000:1.0:1788612494.833635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213504 00000100:00100000:1.0:1788612494.833653:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788612494.833660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932213760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833707:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932213760:12345-0@lo:400:kworker.0 Request processed in 47us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612494.833715:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788612494.833730:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788612494.833736:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932213504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833761:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932213504:12345-0@lo:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612494.833768:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788612494.833783:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214272 00000100:00100000:1.0:1788612494.833786:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214272 00000100:00100000:1.0:1788612494.833812:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214784 00000100:00100000:1.0:1788612494.833814:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214784 00000100:00100000:1.0:1788612494.833829:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612494.833835:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932214272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833862:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932214272:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612494.833868:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612494.833886:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612494.833891:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932214784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612494.833919:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932214784:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612494.833938:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612494.833978:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932213760:0@lo:400:kworker.0 00010000:00080000:1.0:1788612494.833992:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb850e00 x1875495932214272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612494.834002:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932214272:0@lo:400:kworker.0 00010000:00080000:1.0:1788612494.834011:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb851500 x1875495932214784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612494.834019:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932214784:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834247:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932213504:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834256:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932214016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834284:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612494.834311:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932214528:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834333:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612494.834351:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612494.834358:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932213632:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834381:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612494.834400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932214144:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834420:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612494.834431:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932214656:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612494.834489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214016 00000100:00100000:0.0:1788612494.834499:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214016 00000100:00100000:0.0:1788612494.834534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214528 00000100:00100000:0.0:1788612494.834537:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214528 00000100:00100000:0.0:1788612494.834549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214144 00000100:00100000:0.0:1788612494.834551:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214144 00000100:00100000:0.0:1788612494.834561:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214656 00000100:00100000:0.0:1788612494.834563:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214656 00000100:00100000:0.0:1788612494.834577:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612494.834583:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932214016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834621:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932214016:12345-0@lo:400:kworker.0 Request processed in 38us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.834627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612494.834641:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612494.834646:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932214528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834672:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932214528:12345-0@lo:400:kworker.0 Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.834679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612494.834689:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612494.834695:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932214144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834719:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932214144:12345-0@lo:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.834725:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612494.834736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788612494.834742:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932214656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834769:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932214656:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.834775:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788612494.834805:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213632 00000100:00100000:0.0:1788612494.834808:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213632 00000100:00100000:0.0:1788612494.834833:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788612494.834839:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932213632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834869:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932213632:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.834874:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788612494.834902:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932213632:0@lo:400:kworker.0 00010000:00080000:0.0:1788612494.834913:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe976d80 x1875495932214144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612494.834937:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932214144:0@lo:400:kworker.0 00010000:00080000:0.0:1788612494.834948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb852300 x1875495932214656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612494.834956:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932214656:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834965:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932214016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.834973:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932214528:0@lo:400:kworker.0 00000100:00100000:2.0:1788612494.837397:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932213888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612494.837490:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612494.837529:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932214400:0@lo:400:kworker.0 00000100:00100000:2.0:1788612494.837555:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612494.837590:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932214912:0@lo:400:kworker.0 00000100:00100000:2.0:1788612494.837615:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612494.837816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213376 00000100:00100000:2.0:1788612494.837823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213376 00000100:00100000:2.0:1788612494.837873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788612494.837883:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932213376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612494.837934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932213376:12345-0@lo:400:kworker.0 Request processed in 52us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612494.837940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1788612494.837988:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612494.837993:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612494.837997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612494.837999:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612494.838014:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214400 00000100:00100000:2.0:1788612494.838018:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214400 00000100:00100000:2.0:1788612494.838059:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932214912 00000100:00100000:2.0:1788612494.838063:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932214912 00000100:00100000:0.0:1788612494.838076:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932215168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612494.838082:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612494.838087:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932214400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.838108:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612494.838134:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932214400:12345-0@lo:400:kworker.0 Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612494.838141:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612494.838142:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612494.838148:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932215040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612494.838152:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612494.838157:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.838169:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612494.838181:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932214912:12345-0@lo:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612494.838187:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788612494.838192:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215168 00000100:00100000:0.0:1788612494.838196:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215168 00000100:00100000:0.0:1788612494.838218:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215040 00000100:00100000:2.0:1788612494.838222:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932213376:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.838227:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215040 00010000:00080000:2.0:1788612494.838234:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb853800 x1875495932214400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612494.838242:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612494.838245:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932214400:0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.838247:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932215168:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788612494.838254:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb851c00 x1875495932214912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612494.838260:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932214912:0@lo:400:kworker.0 00002000:00000024:0.0:1788612494.838267:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612494.838300:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932215168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.838306:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788612494.838318:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612494.838324:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932215040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612494.838334:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612494.838357:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932215040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.838362:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612494.838385:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932213888 00000100:00100000:0.0:1788612494.838388:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932213888 00000100:00100000:0.0:1788612494.838416:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788612494.838421:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932213888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612494.838456:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932213888:12345-0@lo:400:kworker.0 Request processed in 35us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.838463:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788612494.838502:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1d180 x1875495932215040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612494.838586:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932215040:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788612494.838600:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1fb80 x1875495932215168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612494.838610:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932215168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612494.838647:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932213888:0@lo:400:kworker.0 00000100:00080000:1.0:1788612494.838746:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612494.838749:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612495.343922:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932215296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612495.343984:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612495.344033:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215296 00000100:00100000:3.0:1788612495.344044:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215296 00000100:00100000:1.0:1788612495.344047:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612495.344054:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932215424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612495.344073:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612495.344106:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215424 00000100:00100000:1.0:1788612495.344120:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215424 00000100:00100000:1.0:1788612495.344162:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788612495.344170:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932215424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612495.344198:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612495.344248:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932215424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612495.344262:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788612495.344276:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932215552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612495.344283:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788612495.344291:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932215296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612495.344301:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612495.344321:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612495.344339:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932215296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612495.344345:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612495.344369:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215552 00000100:00100000:0.0:1788612495.344374:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215552 00000100:00100000:0.0:1788612495.344404:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788612495.344411:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932215552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612495.344435:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612495.344472:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932215552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612495.344496:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788612495.344540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932215552:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788612495.345562:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692e300 x1875495932215424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612495.345583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932215424:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788612495.345596:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4ea00 x1875495932215296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612495.345606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932215296:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788612495.729602:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612496.751764:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612497.779082:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612498.416123:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612498.416146:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932215680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612498.416209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612498.417581:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215680 00000100:00100000:0.0:1788612498.417592:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215680 00000100:00100000:0.0:1788612498.417684:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788612498.417694:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932215680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612498.417730:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612498.417813:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932215680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612498.417821:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788612498.417895:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932215680:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788612498.426561:0:11998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:48:16 (1788612496) === 00000100:00100000:3.0:1788612498.520361:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612498.520409:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612498.520436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612498.520461:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318080 00000100:00100000:3.0:1788612498.520509:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318080 00000100:00100000:3.0:1788612498.520575:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317952 00000100:00100000:3.0:1788612498.520578:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317952 00000100:00100000:3.0:1788612498.520607:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:3.0:1788612498.520617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914318080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612498.520691:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914318080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 76us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612498.520699:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:3.0:1788612498.520718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:3.0:1788612498.520726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914317952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612498.520753:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914317952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612498.520768:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:0.0:1788612498.521166:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317824 00000100:00100000:0.0:1788612498.521171:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317824 00000100:00100000:0.0:1788612498.521207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:0.0:1788612498.521214:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2396:x1875495914317824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612498.521241:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2396:x1875495914317824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612498.521254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00080000:2.0:1788612498.522590:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612498.522598:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788612498.799654:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612498.902220:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612498.902367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318208 00000100:00100000:2.0:1788612498.902377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318208 00000100:00100000:2.0:1788612498.902434:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 288 00000100:00100000:2.0:1788612498.902445:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:8712:x1875495914318208:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612498.902461:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612498.902517:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc80b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22062 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612498.902546:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc80b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22062 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612498.902557:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc80b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22062 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612498.902565:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031a00, rc 0) 00000100:00100000:2.0:1788612498.902622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8712:x1875495914318208:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 179us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.902630:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 288 00000100:00100000:3.0:1788612498.905061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612498.908627:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318336 00000100:00100000:0.0:1788612498.908640:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318336 00000100:00100000:2.0:1788612498.908998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:2.0:1788612498.909010:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8712:x1875495914318336:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612498.909199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8712:x1875495914318336:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 191us (4147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.909208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:3.0:1788612498.911158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612498.911288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318464 00000100:00100000:2.0:1788612498.911309:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318464 00000100:00100000:2.0:1788612498.911367:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 290 00000100:00100000:2.0:1788612498.911378:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8712:x1875495914318464:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612498.911961:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8712:x1875495914318464:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 581us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.911970:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 290 00000100:00100000:1.0:1788612498.921125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612498.921595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318592 00000100:00100000:0.0:1788612498.921604:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318592 00000100:00100000:0.0:1788612498.921668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:0.0:1788612498.921678:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8716:x1875495914318592:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612498.921842:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8716:x1875495914318592:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 164us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612498.921851:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:0.0:1788612498.952011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612498.952144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318720 00000100:00100000:3.0:1788612498.952153:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318720 00000100:00100000:3.0:1788612498.952205:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:3.0:1788612498.952216:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8716:x1875495914318720:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612498.952360:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8716:x1875495914318720:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 145us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612498.952369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:3.0:1788612498.963018:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612498.964100:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318848 00000100:00100000:2.0:1788612498.964112:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318848 00000100:00100000:2.0:1788612498.964176:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:2.0:1788612498.964186:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8716:x1875495914318848:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612498.964341:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8716:x1875495914318848:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 155us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.964349:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:1.0:1788612498.973698:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612498.973864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318976 00000100:00100000:0.0:1788612498.973875:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318976 00000100:00100000:0.0:1788612498.973945:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:0.0:1788612498.973955:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:8712:x1875495914318976:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612498.973970:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612498.973987:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe925400/0x1f8616bf0bc80bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22093 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612498.974016:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe925400/0x1f8616bf0bc80bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22093 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612498.974027:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe925400/0x1f8616bf0bc80bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22093 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612498.974036:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe925400, rc 0) 00000100:00100000:0.0:1788612498.974125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:8712:x1875495914318976:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 171us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612498.974133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:2.0:1788612498.981136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612498.981229:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319104 00000100:00100000:3.0:1788612498.981239:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319104 00000100:00100000:3.0:1788612498.981300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:3.0:1788612498.981311:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:8712:x1875495914319104:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788612498.981336:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788612498.981361:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788612498.981366:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788612498.981369:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788612498.981371:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788612498.981374:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788612498.983834:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:8712:x1875495914319104:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 2514us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.983849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:1.0:1788612498.987101:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612498.987200:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319232 00000100:00100000:2.0:1788612498.987210:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319232 00000100:00100000:2.0:1788612498.987269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:2.0:1788612498.987282:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:8712:x1875495914319232:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612498.987298:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612498.987319:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2209a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612498.987349:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612498.987376:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612498.987386:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031000, rc 0) 00000100:00100000:2.0:1788612498.987448:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8712:x1875495914319232:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.987455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:1.0:1788612498.989731:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612498.989983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319360 00000100:00100000:2.0:1788612498.989992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319360 00000100:00100000:2.0:1788612498.990045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:2.0:1788612498.990055:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8712:x1875495914319360:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612498.990321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8712:x1875495914319360:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 266us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.990330:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:0.0:1788612498.993407:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612498.993658:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319488 00000100:00100000:1.0:1788612498.993668:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319488 00000100:00100000:1.0:1788612498.993818:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:1.0:1788612498.993830:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8712:x1875495914319488:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788612498.994044:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8712:x1875495914319488:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 215us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612498.994052:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:0.0:1788612498.996893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612498.997697:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319616 00000100:00100000:1.0:1788612498.997709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319616 00000100:00100000:1.0:1788612498.997769:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:1.0:1788612498.997780:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8720:x1875495914319616:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612498.997937:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8720:x1875495914319616:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 158us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612498.997945:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:1.0:1788612499.000222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612499.000292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319744 00000100:00100000:0.0:1788612499.000301:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319744 00000100:00100000:0.0:1788612499.000349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:0.0:1788612499.000359:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8720:x1875495914319744:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612499.000593:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:8720:x1875495914319744:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 235us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.000603:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:0.0:1788612499.012627:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612499.012677:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612499.012774:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319872 00000100:00100000:1.0:1788612499.012783:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319872 00000100:00100000:1.0:1788612499.012826:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320128 00000100:00100000:1.0:1788612499.012829:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320128 00000100:00100000:1.0:1788612499.012849:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1788612499.012858:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875495914319872:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788612499.012887:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 449720ee-67e1-48cb-85d0-ee79593410d8@192.168.203.30@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1788612499.012936:0:6525:0:(genops.c:1385:class_connect()) connect: client 449720ee-67e1-48cb-85d0-ee79593410d8, cookie 0x1f8616bf0bc80ca 00000004:00100000:1.0:1788612499.012960:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788612499.013067:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9611c7a6f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612499.013139:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+6:2393:x1875495914319872:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 280us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612499.013147:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1788612499.013164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612499.013182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875495914320128:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788612499.013198:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 449720ee-67e1-48cb-85d0-ee79593410d8@192.168.203.30@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1788612499.013220:0:6525:0:(genops.c:1385:class_connect()) connect: client 449720ee-67e1-48cb-85d0-ee79593410d8, cookie 0x1f8616bf0bc80d1 00000004:00100000:1.0:1788612499.013233:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788612499.013283:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9611c7a68000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612499.013307:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+6:2393:x1875495914320128:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 124us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612499.013314:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612499.019164:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612499.019205:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612499.019234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612499.019307:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320256 00000100:00100000:0.0:1788612499.019317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320256 00000100:00100000:0.0:1788612499.019382:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320000 00000100:00100000:0.0:1788612499.019386:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320000 00000100:00100000:0.0:1788612499.019398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320384 00000100:00100000:0.0:1788612499.019401:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320384 00000100:00100000:0.0:1788612499.019415:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1788612499.019424:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+6:0:x1875495914320256:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612499.019466:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612499.019592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+6:0:x1875495914320256:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 168us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.019600:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1788612499.019618:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612499.019638:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+7:0:x1875495914320000:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612499.019657:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612499.019697:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+7:0:x1875495914320000:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 59us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.019703:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612499.019716:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1788612499.019723:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914320384:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612499.019733:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612499.019768:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914320384:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 45us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.019774:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:1.0:1788612499.021636:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612499.021643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612499.021749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612499.021861:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320512 00000100:00100000:3.0:1788612499.021870:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320512 00000100:00100000:3.0:1788612499.021938:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1788612499.021948:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914320512:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788612499.022026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914320512:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.022045:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1788612499.024209:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612499.024250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612499.024280:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612499.024367:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320640 00000100:00100000:2.0:1788612499.024376:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320640 00000100:00100000:2.0:1788612499.024414:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320768 00000100:00100000:2.0:1788612499.024418:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320768 00000100:00100000:2.0:1788612499.024438:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612499.024445:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875495914320640:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788612499.024516:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 449720ee-67e1-48cb-85d0-ee79593410d8@192.168.203.30@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1788612499.024547:0:8441:0:(genops.c:1385:class_connect()) connect: client 449720ee-67e1-48cb-85d0-ee79593410d8, cookie 0x1f8616bf0bc80d8 00002000:00100000:2.0:1788612499.024559:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 449720ee-67e1-48cb-85d0-ee79593410d8/ffff9611c7931800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788612499.024575:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788612499.024658:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788612499.024685:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9611c7936000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612499.024757:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:449720ee-67e1-48cb-85d0-ee79593410d8+6:2393:x1875495914320640:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 311us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.024765:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612499.024783:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1788612499.024788:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875495914320768:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788612499.024804:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 449720ee-67e1-48cb-85d0-ee79593410d8@192.168.203.30@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1788612499.024820:0:8441:0:(genops.c:1385:class_connect()) connect: client 449720ee-67e1-48cb-85d0-ee79593410d8, cookie 0x1f8616bf0bc80df 00002000:00100000:2.0:1788612499.024825:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 449720ee-67e1-48cb-85d0-ee79593410d8/ffff9611c7937800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788612499.024835:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788612499.024865:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788612499.024877:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9611c7934800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612499.024898:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:449720ee-67e1-48cb-85d0-ee79593410d8+6:2393:x1875495914320768:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 108us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.025062:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1788612499.025373:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320896 00000100:00100000:1.0:1788612499.025378:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320896 00000100:00100000:1.0:1788612499.025412:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1788612499.025419:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914320896:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788612499.025453:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914320896:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 35us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612499.025459:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1788612499.032454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612499.032685:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321024 00000100:00100000:2.0:1788612499.032695:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321024 00000100:00100000:2.0:1788612499.032809:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788612499.032820:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914321024:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788612499.032924:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788612499.033010:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:8712:x1875495914321024:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 191us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.033017:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:2.0:1788612499.823918:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612499.952859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932215808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612499.952927:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612499.953108:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932215936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612499.953782:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215808 00000100:00100000:3.0:1788612499.953790:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215808 00000100:00100000:3.0:1788612499.953857:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612499.953867:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932215808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612499.953888:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612499.954019:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932215808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.954026:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612499.954050:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932216192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954089:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788612499.954372:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe942680 x1875495932215808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612499.954392:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932215808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612499.954578:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932216704:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954610:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954629:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932217216:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954650:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954671:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788612499.954677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932216064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954703:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954724:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932216576:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954746:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932217088:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954803:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932217600:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954822:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954876:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.954898:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932216448:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.954921:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.955051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932216320:0@lo:400:kworker.0 00000100:00100000:0.0:1788612499.955076:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.957619:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932216832:0@lo:400:kworker.0 00000100:00100000:0.0:1788612499.957675:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.957705:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932217344:0@lo:400:kworker.0 00000100:00100000:0.0:1788612499.957727:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.957760:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216576 00000100:00100000:0.0:1788612499.957767:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216576 00000100:00100000:0.0:1788612499.957803:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216320 00000100:00100000:0.0:1788612499.957806:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216320 00000100:00100000:0.0:1788612499.957822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788612499.957829:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932216576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612499.957888:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932216576:12345-0@lo:400:kworker.0 Request processed in 58us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.957896:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788612499.957913:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788612499.957918:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932216320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612499.958509:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932215936 00000100:00100000:2.0:1788612499.958515:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932215936 00000100:00100000:2.0:1788612499.958555:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788612499.958561:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932215936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612499.958578:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612499.958616:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932215936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.958622:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788612499.958641:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612499.958652:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216192 00000100:00100000:2.0:1788612499.958656:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216192 00000100:00100000:2.0:1788612499.958675:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216704 00000100:00100000:2.0:1788612499.958677:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216704 00000100:00100000:2.0:1788612499.958696:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217216 00000100:00100000:2.0:1788612499.958699:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217216 00000100:00100000:2.0:1788612499.958710:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216448 00000100:00100000:2.0:1788612499.958712:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216448 00000100:00100000:2.0:1788612499.958720:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216832 00000100:00100000:2.0:1788612499.958722:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216832 00000100:00100000:2.0:1788612499.958732:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217344 00000100:00100000:2.0:1788612499.958734:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217344 00000100:00100000:2.0:1788612499.958748:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788612499.958753:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932216192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612499.958786:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932216192:12345-0@lo:400:kworker.0 Request processed in 32us (4697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.958792:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788612499.958804:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788612499.958809:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932216704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612499.958846:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932216704:12345-0@lo:400:kworker.0 Request processed in 37us (4236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.958852:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788612499.958864:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788612499.958869:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932217216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612499.958894:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932217216:12345-0@lo:400:kworker.0 Request processed in 25us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.958899:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788612499.958910:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788612499.958915:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932216448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.960696:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932216960:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.964836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.964959:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932217472:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965075:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788612499.965130:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1ea00 x1875495932215936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.965154:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932215936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612499.965219:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788612499.965233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932216832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932216832:12345-0@lo:400:kworker.0 Request processed in 62us (7615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.965299:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788612499.965322:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788612499.965330:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932217344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965360:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932217344:12345-0@lo:400:kworker.0 Request processed in 31us (7632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.965366:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788612499.965399:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932216576:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965413:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932216192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932216704:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965447:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932217216:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965502:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217088 00000100:00100000:3.0:1788612499.965508:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217088 00000100:00100000:3.0:1788612499.965537:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217600 00000100:00100000:3.0:1788612499.965540:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217600 00000100:00100000:3.0:1788612499.965552:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216960 00000100:00100000:3.0:1788612499.965554:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216960 00000100:00100000:3.0:1788612499.965565:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217472 00000100:00100000:3.0:1788612499.965568:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217472 00000100:00100000:3.0:1788612499.965579:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612499.965585:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932217088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965834:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932217088:12345-0@lo:400:kworker.0 Request processed in 248us (11046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.965842:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612499.965855:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788612499.965862:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932217600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.965981:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932217600:12345-0@lo:400:kworker.0 Request processed in 119us (11157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.965988:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788612499.966091:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612499.966098:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932216960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.966138:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932216960:12345-0@lo:400:kworker.0 Request processed in 41us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.966144:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612499.966155:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612499.966161:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932217472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.966198:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932217472:12345-0@lo:400:kworker.0 Request processed in 38us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.966205:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788612499.966238:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78bca80 x1875495932217088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.966250:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932217088:0@lo:400:kworker.0 00010000:00080000:3.0:1788612499.966261:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78bd500 x1875495932217600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.966269:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932217600:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.966299:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932216064 00000100:00100000:3.0:1788612499.966303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932216064 00000100:00100000:3.0:1788612499.966334:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788612499.966340:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932216064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.966376:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932216064:12345-0@lo:400:kworker.0 Request processed in 36us (11672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.966383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788612499.966417:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932216064:0@lo:400:kworker.0 00010000:00080000:3.0:1788612499.966444:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fedba300 x1875495932216960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.966452:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932216960:0@lo:400:kworker.0 00010000:00080000:3.0:1788612499.966461:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78bd880 x1875495932217472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.966470:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932217472:0@lo:400:kworker.0 00000100:00080000:3.0:1788612499.966548:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612499.966553:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612499.966556:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788612499.966608:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fedb9f80 x1875495932216832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612499.968343:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932216320:12345-0@lo:400:kworker.0 Request processed in 10417us (13258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.968357:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788612499.970045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932216832:0@lo:400:kworker.0 00010000:00080000:3.0:1788612499.970091:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78bea00 x1875495932217344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.970101:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932217344:0@lo:400:kworker.0 00000100:00100000:3.0:1788612499.970132:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932216320:0@lo:400:kworker.0 00000100:00100000:2.0:1788612499.970341:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932216448:12345-0@lo:400:kworker.0 Request processed in 11423us (15417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.970352:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788612499.970965:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932216448:0@lo:400:kworker.0 00000100:00100000:0.0:1788612500.464990:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612500.465023:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932217728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612500.465095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612500.465155:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612500.465164:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932217856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612500.467247:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612500.467318:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217728 00000100:00100000:0.0:1788612500.467326:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217728 00000100:00100000:0.0:1788612500.467377:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612500.467387:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932217728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612500.467418:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612500.467466:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932217728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612500.467473:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788612500.467533:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe940000 x1875495932217728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612500.467554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932217728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612500.469795:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217856 00000100:00100000:3.0:1788612500.469808:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217856 00000100:00100000:3.0:1788612500.470015:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788612500.470026:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932217856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612500.470058:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788612500.470152:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932217856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612500.470159:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788612500.470221:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932217856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612500.470557:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932217984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612500.470611:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612500.472131:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932217984 00000100:00100000:3.0:1788612500.472143:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932217984 00000100:00100000:3.0:1788612500.472200:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788612500.472220:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932217984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612500.472241:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612500.472311:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932217984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612500.472332:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788612500.472537:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1d500 x1875495932217984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612500.472557:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932217984:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612500.853743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612501.884782:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612502.895629:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612503.535859:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932218112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612503.535931:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612503.536083:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218112 00000100:00100000:0.0:1788612503.536091:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218112 00000100:00100000:0.0:1788612503.536149:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788612503.536158:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932218112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612503.536190:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612503.536250:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932218112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612503.536257:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612503.536408:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932218112:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788612503.919803:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612504.155902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612504.156056:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321152 00000100:00100000:1.0:1788612504.156065:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321152 00000100:00100000:1.0:1788612504.156120:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:1.0:1788612504.156129:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914321152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612504.156213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914321152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612504.156221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:0.0:1788612504.164843:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612504.164983:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321280 00000100:00100000:3.0:1788612504.164992:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321280 00000100:00100000:3.0:1788612504.165079:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:3.0:1788612504.165089:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914321280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.165173:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914321280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.165181:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:3.0:1788612504.167681:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612504.167718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612504.167749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612504.167772:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612504.167792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612504.167815:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321792 00000100:00100000:3.0:1788612504.167823:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321792 00000100:00100000:3.0:1788612504.167879:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321920 00000100:00100000:3.0:1788612504.167882:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321920 00000100:00100000:3.0:1788612504.167904:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1788612504.167913:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321792:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.167970:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.167978:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1788612504.167992:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1788612504.167999:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.168067:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.168074:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1788612504.168104:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321408 00000100:00100000:3.0:1788612504.168108:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321408 00000100:00100000:3.0:1788612504.168131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321536 00000100:00100000:3.0:1788612504.168134:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321536 00000100:00100000:3.0:1788612504.168144:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321664 00000100:00100000:3.0:1788612504.168145:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321664 00000100:00100000:3.0:1788612504.168158:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:3.0:1788612504.168163:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914321408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.168187:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914321408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.168193:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:3.0:1788612504.168202:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:3.0:1788612504.168207:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.168223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.168228:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:3.0:1788612504.168236:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:3.0:1788612504.168241:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.168255:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2397:x1875495914321664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 15us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.168260:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00080000:2.0:1788612504.169026:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612504.169032:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612504.169034:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612504.169036:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788612504.568949:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00100000:1.0:1788612504.569238:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00100000:0.0:1788612504.570924:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00100000:3.0:1788612504.574291:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00010000:00010000:1.0:1788612504.944294:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612505.072503:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612505.072525:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932218240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612505.072590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612505.072615:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218240 00000100:00100000:3.0:1788612505.072623:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218240 00000100:00100000:3.0:1788612505.072667:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612505.072687:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932218240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612505.072715:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612505.072774:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932218240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00080000:2.0:1788612505.072778:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612505.072781:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612505.073005:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932218496:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073035:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073070:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932219008:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073112:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073133:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932219520:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073154:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612505.073160:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932218368:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073182:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218496 00000100:00100000:2.0:1788612505.073186:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218496 00000100:00100000:3.0:1788612505.073189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073209:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219008 00000100:00100000:3.0:1788612505.073210:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932218880:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073212:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219008 00000100:00100000:2.0:1788612505.073227:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219520 00000100:00100000:2.0:1788612505.073230:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219520 00000100:00100000:3.0:1788612505.073232:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073244:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788612505.073247:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932219392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073250:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932218496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.073267:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612505.073283:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932219904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612505.073295:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932218496:12345-0@lo:400:kworker.0 Request processed in 45us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.073301:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788612505.073315:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788612505.073321:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932219008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.073324:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932218752:0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.073345:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073353:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932219008:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.073355:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932219264:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073360:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788612505.073370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218752 00000100:00100000:3.0:1788612505.073372:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073373:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218752 00000100:00100000:3.0:1788612505.073387:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932219776:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073387:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788612505.073392:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932219520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.073403:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073414:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932219520:12345-0@lo:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.073417:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788612505.073420:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788612505.073422:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932218624:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073431:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788612505.073436:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932218752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.073452:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932218752:12345-0@lo:400:kworker.0 Request processed in 25us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612505.073465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788612505.073472:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932219136:0@lo:400:kworker.0 00000100:00080000:2.0:1788612505.073500:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612505.073638:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612505.073704:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932219648:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073731:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932218496:0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.073735:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612505.073745:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932219008:0@lo:400:kworker.0 00000100:00100000:2.0:1788612505.073757:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932219520:0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079070:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932218752:0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218368 00000100:00100000:3.0:1788612505.079183:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218368 00000100:00100000:3.0:1788612505.079235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788612505.079245:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932218368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079313:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932218368:12345-0@lo:400:kworker.0 Request processed in 71us (6122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788612505.079356:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218880 00000100:00100000:3.0:1788612505.079360:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218880 00000100:00100000:3.0:1788612505.079379:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932218624 00000100:00100000:3.0:1788612505.079382:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932218624 00000100:00100000:3.0:1788612505.079396:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612505.079402:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932218880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079449:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932218880:12345-0@lo:400:kworker.0 Request processed in 46us (6214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079455:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612505.079467:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788612505.079473:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932218624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079535:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932218624:12345-0@lo:400:kworker.0 Request processed in 63us (6083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079542:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788612505.079577:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219392 00000100:00100000:3.0:1788612505.079580:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219392 00000100:00100000:3.0:1788612505.079611:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219264 00000100:00100000:3.0:1788612505.079614:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219264 00000100:00100000:3.0:1788612505.079625:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219776 00000100:00100000:3.0:1788612505.079628:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219776 00000100:00100000:3.0:1788612505.079641:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612505.079647:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932219392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079679:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932219392:12345-0@lo:400:kworker.0 Request processed in 32us (6411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079685:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612505.079695:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612505.079700:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932219264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079725:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932219264:12345-0@lo:400:kworker.0 Request processed in 26us (6352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079732:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612505.079741:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612505.079747:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932219776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079771:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932219776:12345-0@lo:400:kworker.0 Request processed in 25us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079777:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612505.079793:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219904 00000100:00100000:3.0:1788612505.079797:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219904 00000100:00100000:3.0:1788612505.079820:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612505.079826:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932219904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612505.079840:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612505.079934:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932219904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (6632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.079947:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612505.079986:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932218368:0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.079998:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932218880:0@lo:400:kworker.0 00010000:00080000:3.0:1788612505.080010:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a8e00 x1875495932219392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612505.080021:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932219392:0@lo:400:kworker.0 00010000:00080000:3.0:1788612505.080033:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1fb80 x1875495932219904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612505.080057:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932219904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612505.080165:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932218624:0@lo:400:kworker.0 00010000:00080000:3.0:1788612505.080178:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe942a00 x1875495932219264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612505.080186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932219264:0@lo:400:kworker.0 00010000:00080000:3.0:1788612505.080196:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79aaa00 x1875495932219776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612505.080203:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932219776:0@lo:400:kworker.0 00000100:00100000:0.0:1788612505.080342:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219136 00000100:00100000:0.0:1788612505.080347:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219136 00000100:00100000:0.0:1788612505.080421:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932219648 00000100:00100000:0.0:1788612505.080425:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932219648 00000100:00100000:3.0:1788612505.080528:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788612505.080536:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932219136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.080578:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932219136:12345-0@lo:400:kworker.0 Request processed in 44us (6940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.080584:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788612505.080606:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612505.080613:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932219648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612505.080641:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932219648:12345-0@lo:400:kworker.0 Request processed in 29us (6914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.080647:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:3.0:1788612505.080672:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe940000 x1875495932219136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612505.080683:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932219136:0@lo:400:kworker.0 00010000:00080000:3.0:1788612505.080693:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a8000 x1875495932219648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612505.080700:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932219648:0@lo:400:kworker.0 00010000:00080000:0.0:1788612505.081572:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1ea00 x1875495932218240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612505.081589:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932218240:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788612505.083614:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612505.083623:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612505.083625:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788612505.361231:0:12191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788612505.583630:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612505.583644:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932220032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612505.583649:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932220160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612505.584210:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612505.584840:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612505.584852:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932220288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612505.584892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612505.584946:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220032 00000100:00100000:3.0:1788612505.584954:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220032 00000100:00100000:3.0:1788612505.585002:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788612505.585011:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932220032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612505.585038:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612505.585103:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932220032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612505.585110:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788612505.585167:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220288 00000100:00100000:1.0:1788612505.585172:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220288 00000100:00100000:1.0:1788612505.585210:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788612505.585217:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932220288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612505.585240:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612505.585276:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932220288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612505.585283:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788612505.585421:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932220288:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1788612505.585539:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a9880 x1875495932220032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612505.585553:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932220032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612505.586406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612505.586608:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220160 00000100:00100000:1.0:1788612505.586615:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220160 00000100:00100000:1.0:1788612505.586700:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788612505.586710:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932220160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612505.586729:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612505.586799:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932220160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612505.586807:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788612505.586873:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b8a80 x1875495932220160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612505.586891:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932220160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788612505.972628:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612506.992294:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612508.016351:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612508.655789:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932220416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612508.655867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612508.655970:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220416 00000100:00100000:1.0:1788612508.655992:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220416 00000100:00100000:1.0:1788612508.656062:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788612508.656071:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932220416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612508.656106:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788612508.662415:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932220416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6336us (6539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612508.662428:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788612508.662974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932220416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788612509.039681:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612509.278439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278563:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612509.278675:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322048 00000100:00100000:1.0:1788612509.278688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322048 00000100:00100000:1.0:1788612509.278766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:1.0:1788612509.278778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914322048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612509.278868:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914322048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 92us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612509.278876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:3.0:1788612509.279211:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322816 00000100:00100000:3.0:1788612509.279216:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322816 00000100:00100000:3.0:1788612509.279298:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322688 00000100:00100000:3.0:1788612509.279301:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322688 00000100:00100000:3.0:1788612509.279337:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612509.279346:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612509.279384:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612509.279390:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612509.279404:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612509.279411:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612509.279435:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612509.279441:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612509.279515:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322304 00000100:00100000:3.0:1788612509.279519:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322304 00000100:00100000:1.0:1788612509.280571:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322560 00000100:00100000:1.0:1788612509.280582:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322560 00000100:00100000:1.0:1788612509.280628:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322176 00000100:00100000:1.0:1788612509.280633:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322176 00000100:00100000:3.0:1788612509.280642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322432 00000100:00100000:3.0:1788612509.280646:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322432 00000100:00100000:1.0:1788612509.280656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1788612509.280664:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612509.280665:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1788612509.280671:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914322304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612509.281827:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1151us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612509.281843:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1788612509.281882:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1788612509.282380:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914322176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:2.0:1788612509.282560:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612509.282567:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612509.282571:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612509.282574:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612509.284645:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612509.284665:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788612509.284686:0:8253:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612509.284705:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1788612509.284723:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612509.284799:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914322432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (6182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612509.284808:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1788612509.287236:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914322176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 5332us (8637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612509.287253:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1788612509.293078:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914322304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 12388us (14545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612509.293098:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00010000:00010000:2.0:1788612510.063774:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612510.193305:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932220544:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193375:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.193434:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932221056:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193463:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.193500:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932221568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193522:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.193539:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932222080:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193557:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.193579:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788612510.193584:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932220928:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193625:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.193645:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932221440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193668:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.193686:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932221952:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.193705:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.194909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932220672:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.194955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.194976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932221184:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.194996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195023:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932221696:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195043:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932222208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612510.195083:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195105:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788612510.195111:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932220800:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195153:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195171:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932221312:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195191:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932221824:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195234:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932222336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612510.195251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612510.195285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220544 00000100:00100000:0.0:1788612510.195293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220544 00000100:00100000:0.0:1788612510.195349:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788612510.195358:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932220544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195420:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932220544:12345-0@lo:400:kworker.0 Request processed in 63us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.195428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788612510.195471:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221056 00000100:00100000:0.0:1788612510.195501:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221056 00000100:00100000:0.0:1788612510.195521:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220800 00000100:00100000:0.0:1788612510.195523:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220800 00000100:00100000:0.0:1788612510.195535:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612510.195541:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932221056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195575:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932221056:12345-0@lo:400:kworker.0 Request processed in 34us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.195581:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612510.195592:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788612510.195597:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c4858c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932220800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.195629:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c4858c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932220800:12345-0@lo:400:kworker.0 Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.195636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788612510.195880:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221568 00000100:00100000:0.0:1788612510.195884:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221568 00000100:00100000:0.0:1788612510.195911:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222080 00000100:00100000:0.0:1788612510.195915:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222080 00000100:00100000:0.0:1788612510.195933:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221440 00000100:00100000:0.0:1788612510.195936:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221440 00000100:00100000:0.0:1788612510.195949:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221952 00000100:00100000:0.0:1788612510.195951:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221952 00000100:00100000:0.0:1788612510.195965:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612510.195971:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932221568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196001:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932221568:12345-0@lo:400:kworker.0 Request processed in 31us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196017:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612510.196030:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612510.196035:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196071:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932222080:12345-0@lo:400:kworker.0 Request processed in 36us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196077:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612510.196089:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788612510.196095:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932221440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196124:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932221440:12345-0@lo:400:kworker.0 Request processed in 29us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196130:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788612510.196142:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612510.196148:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932221952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196175:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932221952:12345-0@lo:400:kworker.0 Request processed in 28us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196182:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612510.196203:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220928 00000100:00100000:0.0:1788612510.196207:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220928 00000100:00100000:0.0:1788612510.196225:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932220672 00000100:00100000:0.0:1788612510.196228:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932220672 00000100:00100000:0.0:1788612510.196238:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221184 00000100:00100000:0.0:1788612510.196240:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221184 00000100:00100000:0.0:1788612510.196251:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221696 00000100:00100000:0.0:1788612510.196254:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221696 00000100:00100000:0.0:1788612510.196266:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221312 00000100:00100000:0.0:1788612510.196269:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221312 00000100:00100000:0.0:1788612510.196279:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932221824 00000100:00100000:0.0:1788612510.196282:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932221824 00000100:00100000:0.0:1788612510.196294:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788612510.196300:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932220928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196330:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932220928:12345-0@lo:400:kworker.0 Request processed in 30us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196342:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788612510.196354:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788612510.196360:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932220672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196390:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932220672:12345-0@lo:400:kworker.0 Request processed in 30us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196396:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788612510.196407:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788612510.196413:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932221184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196439:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932221184:12345-0@lo:400:kworker.0 Request processed in 27us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196445:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788612510.196457:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788612510.196463:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196511:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932221696:12345-0@lo:400:kworker.0 Request processed in 49us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196517:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788612510.196528:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612510.196535:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932221312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196561:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932221312:12345-0@lo:400:kworker.0 Request processed in 27us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196567:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612510.196578:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612510.196584:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932221824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196610:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932221824:12345-0@lo:400:kworker.0 Request processed in 26us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196622:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612510.196654:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222208 00000100:00100000:0.0:1788612510.196658:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222208 00000100:00100000:0.0:1788612510.196683:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222336 00000100:00100000:0.0:1788612510.196687:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222336 00000100:00100000:0.0:1788612510.196698:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788612510.196704:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932222208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612510.196724:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612510.196756:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932222208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196762:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788612510.196773:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612510.196780:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932222336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612510.196789:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612510.196812:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932222336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612510.196818:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612510.196865:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932220800:0@lo:400:kworker.0 00010000:00080000:0.0:1788612510.196880:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a9f80 x1875495932221312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612510.196890:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932221312:0@lo:400:kworker.0 00010000:00080000:0.0:1788612510.196900:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79ab100 x1875495932221824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612510.196909:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932221824:0@lo:400:kworker.0 00010000:00080000:0.0:1788612510.196930:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79baa00 x1875495932222336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612510.196943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932222336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612510.196955:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932220672:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196963:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932221184:0@lo:400:kworker.0 00000100:00100000:0.0:1788612510.196972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932221696:0@lo:400:kworker.0 00010000:00080000:0.0:1788612510.196981:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b8a80 x1875495932222208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612510.196991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932222208:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788612510.197152:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612510.197157:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612510.197159:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612510.197161:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612510.199755:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932220928:0@lo:400:kworker.0 00010000:00080000:3.0:1788612510.199773:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a9c00 x1875495932221440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612510.199794:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932221440:0@lo:400:kworker.0 00010000:00080000:3.0:1788612510.199806:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a9880 x1875495932221952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612510.199821:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932221952:0@lo:400:kworker.0 00000100:00100000:3.0:1788612510.199832:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932220544:0@lo:400:kworker.0 00000100:00100000:3.0:1788612510.199842:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932221056:0@lo:400:kworker.0 00010000:00080000:3.0:1788612510.199853:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79ab800 x1875495932221568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612510.199861:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932221568:0@lo:400:kworker.0 00010000:00080000:3.0:1788612510.199870:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a8000 x1875495932222080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612510.199878:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932222080:0@lo:400:kworker.0 00000100:00100000:2.0:1788612510.704075:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612510.704100:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932222464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612510.704170:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612510.704558:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932222592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612510.704587:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612510.704689:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222464 00000100:00100000:3.0:1788612510.704697:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222464 00000100:00100000:3.0:1788612510.704741:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222592 00000100:00100000:3.0:1788612510.704743:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222592 00000100:00100000:3.0:1788612510.704761:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612510.704771:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932222464:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612510.704776:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612510.704789:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932222592:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612510.704810:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932222720:0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1788612510.704813:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788612510.704813:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612510.704874:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932222592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612510.704876:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932222464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612510.704897:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612510.704901:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612510.704914:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788612510.704951:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222720 00000100:00100000:1.0:1788612510.704956:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222720 00010000:00080000:2.0:1788612510.704960:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b9500 x1875495932222592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612510.704979:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932222592:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788612510.704990:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79d7100 x1875495932222464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612510.705001:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932222464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612510.705056:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788612510.705064:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932222720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612510.705087:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612510.705137:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932222720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612510.705144:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788612510.705207:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932222720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788612511.089585:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612512.113586:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612513.136033:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788612513.664884:0:12508:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612513.665120:0:12508:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788612513.777500:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932222848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612513.777567:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612513.777604:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222848 00000100:00100000:3.0:1788612513.777612:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222848 00000100:00100000:3.0:1788612513.777666:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788612513.777676:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932222848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612513.777707:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788612513.777768:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932222848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612513.777775:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788612513.777884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932222848:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612514.160240:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612514.397595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612514.397634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612514.397652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612514.397685:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612514.397707:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612514.397742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612514.397765:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612514.397887:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323072 00000100:00100000:0.0:1788612514.397898:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323072 00000100:00100000:0.0:1788612514.397949:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323328 00000100:00100000:0.0:1788612514.397952:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323328 00000100:00100000:0.0:1788612514.397966:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323200 00000100:00100000:0.0:1788612514.397969:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323200 00000100:00100000:0.0:1788612514.397992:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323456 00000100:00100000:0.0:1788612514.397995:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323456 00000100:00100000:0.0:1788612514.398010:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:0.0:1788612514.398019:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914323072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612514.398092:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914323072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 74us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612514.398100:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:0.0:1788612514.398119:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1788612514.398126:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914323328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612514.398150:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914323328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612514.398156:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1788612514.398168:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:0.0:1788612514.398186:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914323200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612514.398210:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914323200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612514.398216:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:0.0:1788612514.398227:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:0.0:1788612514.398233:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914323456:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612514.398255:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914323456:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612514.398261:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1788612514.398399:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322944 00000100:00100000:3.0:1788612514.398404:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322944 00000100:00100000:3.0:1788612514.398430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 306 00000100:00100000:3.0:1788612514.398436:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914322944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612514.398459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914322944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.398465:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 306 00000100:00080000:2.0:1788612514.398662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612514.398667:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612514.400516:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323584 00000100:00100000:1.0:1788612514.400529:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323584 00000100:00100000:1.0:1788612514.400590:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323712 00000100:00100000:1.0:1788612514.400594:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323712 00000100:00100000:1.0:1788612514.400625:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1788612514.400636:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914323584:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612514.400711:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914323584:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612514.400719:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1788612514.400734:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1788612514.400741:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914323712:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612514.400761:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914323712:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612514.400767:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00080000:2.0:1788612514.400976:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612514.400990:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788612515.185942:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612515.314723:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932223104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612515.314818:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612515.314885:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612515.314892:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932222976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612515.314915:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612515.314945:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223104 00000100:00100000:2.0:1788612515.314952:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223104 00000100:00100000:2.0:1788612515.315012:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932222976 00000100:00100000:2.0:1788612515.315015:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932222976 00000100:00100000:2.0:1788612515.315034:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612515.315043:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932223104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612515.315072:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612515.315113:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932223104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612515.315134:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612515.315152:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612515.315159:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932222976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612515.315167:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612515.315191:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932222976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612515.315196:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788612515.315212:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612515.315241:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79d4e00 x1875495932222976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612515.315257:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932222976:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788612515.315267:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b9500 x1875495932223104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612515.315277:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932223104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612515.315826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932223488:0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.315860:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.315882:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932224000:0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.315905:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.315921:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932224512:0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.315947:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.315963:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788612515.315968:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932223616:0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316000:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.316013:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932224128:0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316032:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.316059:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223488 00000100:00100000:3.0:1788612515.316063:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223488 00000100:00100000:3.0:1788612515.316093:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788612515.316099:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316134:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932223488:12345-0@lo:400:kworker.0 Request processed in 35us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.316140:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788612515.316156:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224000 00000100:00100000:3.0:1788612515.316159:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224000 00000100:00100000:3.0:1788612515.316184:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224512 00000100:00100000:3.0:1788612515.316186:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224512 00000100:00100000:3.0:1788612515.316202:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223616 00000100:00100000:3.0:1788612515.316204:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223616 00000100:00100000:3.0:1788612515.316217:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788612515.316223:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932224000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316251:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932224000:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.316257:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788612515.316268:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788612515.316274:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932224512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316299:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932224512:12345-0@lo:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.316311:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788612515.316323:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788612515.316330:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932223616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316356:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932223616:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.316361:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788612515.316392:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224128 00000100:00100000:3.0:1788612515.316395:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224128 00000100:00100000:3.0:1788612515.316421:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612515.316427:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316451:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932224128:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.316456:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612515.316515:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932223616:0@lo:400:kworker.0 00010000:00080000:3.0:1788612515.316527:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1d500 x1875495932224128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612515.316537:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932224128:0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.316546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932223488:0@lo:400:kworker.0 00010000:00080000:3.0:1788612515.316554:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1c700 x1875495932224000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612515.316562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932224000:0@lo:400:kworker.0 00010000:00080000:3.0:1788612515.316570:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bed80 x1875495932224512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612515.316588:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932224512:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.316984:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932223232:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.317020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612515.317051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932223744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.317070:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612515.317085:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932224256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.317111:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612515.317129:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612515.317135:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932223360:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.317156:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612515.317168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932223872:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.317186:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612515.317197:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932224384:0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.317216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.317557:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223232 00000100:00100000:3.0:1788612515.317563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223232 00000100:00100000:3.0:1788612515.317596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788612515.317604:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932223232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.317645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932223232:12345-0@lo:400:kworker.0 Request processed in 43us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.317650:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788612515.317676:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224256 00000100:00100000:3.0:1788612515.317679:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224256 00000100:00100000:3.0:1788612515.317704:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612515.317710:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932224256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612515.317737:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932224256:12345-0@lo:400:kworker.0 Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.317743:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612515.317764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223360 00000100:00100000:3.0:1788612515.317768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223360 00000100:00100000:0.0:1788612515.318398:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223744 00000100:00100000:0.0:1788612515.318404:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223744 00000100:00100000:0.0:1788612515.318435:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788612515.318442:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.318499:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932223744:12345-0@lo:400:kworker.0 Request processed in 57us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612515.318505:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788612515.318523:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932223872 00000100:00100000:0.0:1788612515.318526:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932223872 00000100:00100000:0.0:1788612515.318541:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224384 00000100:00100000:0.0:1788612515.318544:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224384 00000100:00100000:0.0:1788612515.318557:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788612515.318562:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932223360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.318590:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932223360:12345-0@lo:400:kworker.0 Request processed in 27us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612515.318595:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788612515.318617:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788612515.318622:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932223872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.318660:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932223872:12345-0@lo:400:kworker.0 Request processed in 37us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612515.318665:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788612515.318675:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788612515.318680:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932224384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612515.318704:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932224384:12345-0@lo:400:kworker.0 Request processed in 24us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612515.318709:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1788612515.318913:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612515.318918:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612515.318921:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612515.318966:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932223360:0@lo:400:kworker.0 00000100:00100000:2.0:1788612515.318989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932223872:0@lo:400:kworker.0 00000100:00100000:2.0:1788612515.318999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932224384:0@lo:400:kworker.0 00000100:00100000:2.0:1788612515.319008:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932223232:0@lo:400:kworker.0 00000100:00100000:2.0:1788612515.319018:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932223744:0@lo:400:kworker.0 00010000:00080000:2.0:1788612515.319041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1ea00 x1875495932224256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612515.319051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932224256:0@lo:400:kworker.0 00000020:00000004:1.0:1788612515.782987:0:12605:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612515.783225:0:12605:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788612515.825192:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612515.825214:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932224640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612515.825280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612515.825362:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224640 00000100:00100000:2.0:1788612515.825371:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224640 00000100:00100000:2.0:1788612515.825425:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612515.825434:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932224640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612515.825462:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612515.825529:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932224640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612515.825536:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788612515.825587:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0380 x1875495932224640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612515.825604:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932224640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612515.826001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932224768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612515.826030:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612515.826105:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224768 00000100:00100000:1.0:1788612515.826109:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224768 00000100:00100000:1.0:1788612515.826143:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788612515.826150:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932224768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612515.826172:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612515.826204:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932224768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612515.826216:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788612515.826275:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932224768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612515.827336:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932224896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612515.827386:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612515.827965:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932224896 00000100:00100000:3.0:1788612515.827982:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932224896 00000100:00100000:3.0:1788612515.828096:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788612515.828105:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932224896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612515.828127:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612515.828175:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932224896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612515.828182:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788612515.828260:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bed80 x1875495932224896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612515.828279:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932224896:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612516.209992:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612517.231846:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612518.074678:0:12702:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612518.075072:0:12702:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612518.257898:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612518.896194:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612518.904132:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932225024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612518.904210:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612518.913605:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225024 00000100:00100000:0.0:1788612518.913620:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225024 00000100:00100000:0.0:1788612518.913683:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788612518.913694:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932225024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612518.913731:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612518.914975:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932225024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1279us (10760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612518.914987:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788612518.919561:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932225024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612519.288925:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612519.515368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612519.515411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612519.515443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612519.515513:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324480 00000100:00100000:2.0:1788612519.515522:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324480 00000100:00100000:3.0:1788612519.515560:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324608 00000100:00100000:3.0:1788612519.515564:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324608 00000100:00080000:2.0:1788612519.515619:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612519.515630:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1788612519.515640:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2393:x1875495914324608:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:3.0:1788612519.515670:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc80df 00000100:00080000:3.0:1788612519.515680:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9611c7934800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612519.515732:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788612519.515885:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:449720ee-67e1-48cb-85d0-ee79593410d8+2:2393:x1875495914324608:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 247us (440us total) trans 0 rc 0/0 00010000:00010000:2.0:1788612519.515885:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612519.515893:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1788612519.516162:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1788612519.516171:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2393:x1875495914324480:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:1.0:1788612519.516184:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc80d8 00000100:00080000:1.0:1788612519.516189:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9611c7936000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612519.516220:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788612519.516308:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:449720ee-67e1-48cb-85d0-ee79593410d8+2:2393:x1875495914324480:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 138us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612519.516314:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00080000:2.0:1788612519.516328:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788612519.516328:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612519.516731:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612519.516769:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612519.516794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612519.516818:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612519.516837:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323968 00000100:00100000:1.0:1788612519.516841:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323968 00000100:00100000:1.0:1788612519.516873:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324224 00000100:00100000:1.0:1788612519.516876:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324224 00000100:00100000:2.0:1788612519.516886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324096 00000100:00100000:2.0:1788612519.516889:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324096 00000100:00100000:1.0:1788612519.516889:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324352 00000100:00100000:1.0:1788612519.516902:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324352 00000100:00100000:2.0:1788612519.516910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:2.0:1788612519.516916:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914323968:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612519.516918:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:1.0:1788612519.516923:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914324224:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612519.516961:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914323968:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 44us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612519.516968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:3.0:1788612519.516980:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:0.0:1788612519.517025:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323840 00000100:00100000:0.0:1788612519.517029:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323840 00000100:00100000:0.0:1788612519.517057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:0.0:1788612519.517064:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914323840:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612519.517097:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914324096:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612519.518032:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914324224:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1104us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612519.518101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914323840:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1035us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612519.518109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:3.0:1788612519.518301:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914324096:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1313us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612519.524742:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:2.0:1788612519.524780:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914324352:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612519.524862:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914324352:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (8042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612519.524870:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:1.0:1788612519.526032:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00080000:1.0:1788612519.526640:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612519.526646:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612519.536418:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 156 00010000:00010000:3.0:1788612520.303692:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612520.432622:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612520.432645:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932225152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612520.432718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.432785:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225152 00000100:00100000:2.0:1788612520.432792:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225152 00000100:00100000:2.0:1788612520.432841:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612520.432849:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fefbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932225152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612520.432877:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612520.432957:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fefbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932225152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.432965:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788612520.433179:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612520.433200:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932225280:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433260:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612520.433282:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932225664:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932225792:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433343:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.433376:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932226304:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433401:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.433421:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788612520.433427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932225408:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.433469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932225920:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433513:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.433532:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932226432:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.433583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225280 00000100:00100000:2.0:1788612520.433587:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225280 00000100:00100000:2.0:1788612520.433617:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788612520.433624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932225280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433658:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932225280:12345-0@lo:400:kworker.0 Request processed in 36us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.433665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788612520.433687:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225792 00000100:00100000:2.0:1788612520.433691:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225792 00000100:00100000:2.0:1788612520.433727:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788612520.433733:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932225792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.433766:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932225792:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.433772:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788612520.433789:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226304 00000100:00100000:2.0:1788612520.433793:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226304 00000100:00100000:2.0:1788612520.433829:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612520.433836:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932226304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612520.433877:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.433880:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932226304:12345-0@lo:400:kworker.0 Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.433888:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612520.433911:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225408 00000100:00100000:2.0:1788612520.433916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225408 00000100:00100000:2.0:1788612520.433965:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225920 00000100:00100000:2.0:1788612520.433970:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225920 00000100:00100000:2.0:1788612520.433985:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226432 00000100:00100000:2.0:1788612520.433987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226432 00000100:00100000:2.0:1788612520.433999:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225664 00000100:00100000:2.0:1788612520.434002:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225664 00000100:00100000:2.0:1788612520.434016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788612520.434022:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932225408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434055:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932225408:12345-0@lo:400:kworker.0 Request processed in 33us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.434061:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788612520.434073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788612520.434079:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932225920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932225920:12345-0@lo:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612520.434112:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932226176:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788612520.434149:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788612520.434156:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932226432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434191:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932226432:12345-0@lo:400:kworker.0 Request processed in 37us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.434198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788612520.434213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788612520.434222:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.434233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932225664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612520.434259:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932226688:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932225664:12345-0@lo:400:kworker.0 Request processed in 61us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612520.434301:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.434307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1788612520.434348:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612520.434351:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612520.434366:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932225536:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434401:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.434426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932226048:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434452:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.434513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932226560:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434536:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788612520.434568:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bbb80 x1875495932225152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612520.434587:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932225152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612520.434620:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226048 00000100:00100000:2.0:1788612520.434624:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226048 00000100:00100000:2.0:1788612520.434661:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226560 00000100:00100000:2.0:1788612520.434664:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226560 00000100:00100000:2.0:1788612520.434678:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788612520.434684:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932226048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434717:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932226048:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.434723:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788612520.434734:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788612520.434739:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932226560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.434763:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932226560:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.434768:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788612520.434782:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612520.434789:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932225536 00000100:00100000:2.0:1788612520.434792:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932225536 00000100:00100000:2.0:1788612520.434811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612520.434818:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932225536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612520.434866:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932225664:0@lo:400:kworker.0 00000100:00100000:0.0:1788612520.434969:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612520.434980:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932226816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612520.435562:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226176 00000100:00100000:3.0:1788612520.435570:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226176 00000100:00100000:3.0:1788612520.435628:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226688 00000100:00100000:3.0:1788612520.435632:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226688 00000100:00100000:3.0:1788612520.435655:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612520.435663:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932226176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.438060:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932225536:12345-0@lo:400:kworker.0 Request processed in 3232us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.438074:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612520.438147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932225536:0@lo:400:kworker.0 00010000:00080000:2.0:1788612520.438167:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bce00 x1875495932226048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612520.438179:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932226048:0@lo:400:kworker.0 00010000:00080000:2.0:1788612520.438191:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bd880 x1875495932226560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612520.438223:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932226560:0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.438294:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612520.438306:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932226688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612520.443952:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932226688:12345-0@lo:400:kworker.0 Request processed in 5632us (9638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.443967:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788612520.444141:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612520.444147:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788612520.444205:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bd500 x1875495932226688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612520.444220:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932226688:0@lo:400:kworker.0 00000100:00100000:1.0:1788612520.446138:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932225408:0@lo:400:kworker.0 00000100:00100000:1.0:1788612520.446169:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932225920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612520.446189:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932226432:0@lo:400:kworker.0 00000100:00100000:1.0:1788612520.446209:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932225792:0@lo:400:kworker.0 00010000:00080000:1.0:1788612520.446230:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bc000 x1875495932226304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612520.446242:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932226304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612520.446258:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932225280:0@lo:400:kworker.0 00000100:00100000:3.0:1788612520.447021:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932226176:12345-0@lo:400:kworker.0 Request processed in 11350us (12798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612520.447037:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612520.447512:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788612520.447691:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bca80 x1875495932226176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612520.447707:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932226176:0@lo:400:kworker.0 00000100:00100000:3.0:1788612520.447843:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226816 00000100:00100000:3.0:1788612520.447866:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226816 00000100:00100000:3.0:1788612520.447931:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788612520.447952:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932226816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612520.447985:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612520.448065:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932226816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612520.448074:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788612520.448113:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79d7100 x1875495932226816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612520.448139:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932226816:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788612520.486571:0:12800:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612520.486785:0:12800:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788612520.947220:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932227072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612520.947286:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612520.947370:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227072 00000100:00100000:3.0:1788612520.947377:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227072 00000100:00100000:3.0:1788612520.947427:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612520.947435:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932227072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612520.947467:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612520.947539:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932227072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612520.947633:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788612520.947685:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1ed80 x1875495932227072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612520.947705:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932227072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612520.951704:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932226944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612520.951778:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612520.951846:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932226944 00000100:00100000:2.0:1788612520.951854:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932226944 00000100:00100000:2.0:1788612520.951900:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788612520.951908:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932226944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612520.952037:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612520.952085:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932226944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612520.952092:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612520.953066:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612ea239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932227200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612520.953109:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612520.953160:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227200 00000100:00100000:1.0:1788612520.953165:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227200 00000100:00100000:1.0:1788612520.953201:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788612520.953208:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932227200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612520.953224:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612520.953269:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932227200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612520.953276:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788612520.953307:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612ea239f80 x1875495932227200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612520.953325:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612ea239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932227200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612520.953825:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932226944:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788612521.327645:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612522.352523:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788612523.114042:0:12897:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612523.114269:0:12897:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612523.381395:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612524.017193:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612524.017217:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932227328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612524.017280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612524.017380:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227328 00000100:00100000:2.0:1788612524.017387:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227328 00000100:00100000:2.0:1788612524.017440:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612524.017448:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932227328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612524.017504:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612524.017550:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932227328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612524.017556:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788612524.017643:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932227328:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612524.399723:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612524.632603:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612524.632649:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612524.632679:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612524.632721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612524.632757:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612524.632793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324992 00000100:00100000:1.0:1788612524.632803:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324992 00000100:00100000:0.0:1788612524.633084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324736 00000100:00100000:0.0:1788612524.633089:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324736 00000100:00100000:0.0:1788612524.633132:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 310 00000100:00100000:0.0:1788612524.633143:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914324736:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612524.633209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914324736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.633217:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 310 00000100:00100000:0.0:1788612524.633364:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325248 00000100:00100000:0.0:1788612524.633368:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325248 00000100:00100000:0.0:1788612524.633397:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324864 00000100:00100000:0.0:1788612524.633399:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324864 00000100:00100000:0.0:1788612524.633425:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325120 00000100:00100000:0.0:1788612524.633428:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325120 00000100:00100000:0.0:1788612524.633444:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1788612524.633449:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914325248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612524.633512:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914325248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 61us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.633519:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1788612524.633532:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1788612524.633538:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914324864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612524.633576:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914324864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.633582:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1788612524.633594:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:0.0:1788612524.633616:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914325120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612524.633642:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914325120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.633648:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00080000:0.0:1788612524.633751:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612524.633756:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612524.634117:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:1.0:1788612524.634128:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ea239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914324992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612524.634169:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ea239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914324992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 44us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612524.634177:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00010000:00010000:1.0:1788612525.427773:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612525.554670:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612525.554698:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932227456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612525.554787:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612525.559338:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227456 00000100:00100000:3.0:1788612525.559350:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227456 00000100:00100000:3.0:1788612525.559434:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612525.559442:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788612525.559451:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932227456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612525.559510:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612525.559547:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612525.559727:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227584 00000100:00100000:2.0:1788612525.559732:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227584 00000100:00100000:2.0:1788612525.559767:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788612525.559774:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932227584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.564513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932227712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612525.564662:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.564712:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932228224:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.564745:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.564770:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932228736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.564798:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.564832:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788612525.564834:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228736 00000100:00100000:1.0:1788612525.564840:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932227840:0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.564845:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228736 00000100:00100000:2.0:1788612525.564920:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612525.564932:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932228736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.565077:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932228352:0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565103:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932228736:12345-0@lo:400:kworker.0 Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.565108:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612525.565120:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788612525.565145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932228864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565169:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612525.565211:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4380 x1875495932228736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612525.565230:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932227584:12345-0@lo:400:kworker.0 Request processed in 5455us (5683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.565241:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932228736:0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565242:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788612525.565273:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932227584:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565307:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932228096:0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565322:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932227968:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565337:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612525.565360:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.565363:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565390:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932228480:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565392:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.565417:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932229120:0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565426:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.565445:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612525.565451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932228992:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565505:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227712 00000100:00100000:1.0:1788612525.565510:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227712 00000100:00100000:2.0:1788612525.565516:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612525.565556:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612525.565559:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228608 00000100:00100000:2.0:1788612525.565563:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228608 00000100:00100000:1.0:1788612525.565576:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932227712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612525.565595:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229120 00000100:00100000:2.0:1788612525.565600:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229120 00002000:00000024:1.0:1788612525.565601:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612525.565619:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612525.565628:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932228608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565650:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932227712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.565658:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612525.565682:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228224 00000100:00100000:1.0:1788612525.565687:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228224 00000100:00100000:2.0:1788612525.565689:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932228608:12345-0@lo:400:kworker.0 Request processed in 62us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612525.565698:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612525.565713:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612525.565720:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932229120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565737:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227968 00000100:00100000:1.0:1788612525.565741:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227968 00000100:00100000:2.0:1788612525.565750:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932229120:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612525.565761:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788612525.565762:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788612525.565773:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932228224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565782:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932227840 00000100:00100000:2.0:1788612525.565792:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932227840 00000100:00100000:1.0:1788612525.565816:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932228224:12345-0@lo:400:kworker.0 Request processed in 45us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612525.565817:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228352 00000100:00100000:2.0:1788612525.565822:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228352 00000100:00100000:1.0:1788612525.565826:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788612525.565843:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612525.565845:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228864 00000100:00100000:2.0:1788612525.565849:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228864 00000100:00100000:1.0:1788612525.565853:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932227968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565870:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228096 00000100:00100000:2.0:1788612525.565874:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228096 00000100:00100000:1.0:1788612525.565885:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932227968:12345-0@lo:400:kworker.0 Request processed in 36us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612525.565889:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228480 00000100:00100000:1.0:1788612525.565891:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612525.565893:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228480 00000100:00100000:1.0:1788612525.565922:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932228992 00000100:00100000:2.0:1788612525.565927:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788612525.565927:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932228992 00000100:00100000:2.0:1788612525.565937:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932227840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.565957:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788612525.565965:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932228352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.565977:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932227840:12345-0@lo:400:kworker.0 Request processed in 41us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612525.565985:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788612525.566004:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788612525.566006:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932228352:12345-0@lo:400:kworker.0 Request processed in 40us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612525.566014:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932228864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.566017:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788612525.566037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788612525.566050:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932228864:12345-0@lo:400:kworker.0 Request processed in 38us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.566054:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932228096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.566062:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788612525.566077:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788612525.566084:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932228480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.566096:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932228096:12345-0@lo:400:kworker.0 Request processed in 46us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.566104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788612525.566122:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932228480:12345-0@lo:400:kworker.0 Request processed in 36us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.566123:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788612525.566133:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788612525.566134:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932228992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612525.566172:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932228096:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.566178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932228992:12345-0@lo:400:kworker.0 Request processed in 46us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.566187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00010000:00080000:2.0:1788612525.566188:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc7b80 x1875495932228608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612525.566211:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932228608:0@lo:400:kworker.0 00010000:00080000:2.0:1788612525.566223:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4700 x1875495932229120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612525.566233:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932229120:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.566267:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932227840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612525.566279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932228352:0@lo:400:kworker.0 00000001:00100000:2.0:1788612525.566289:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000100:00100000:1.0:1788612525.566290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932228864:0@lo:400:kworker.0 00000020:00000080:2.0:1788612525.566297:0:9518:0:(genops.c:885:class_export_put()) final put ffff9611c7937800/449720ee-67e1-48cb-85d0-ee79593410d8 00010000:00080000:1.0:1788612525.566303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1f100 x1875495932227712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612525.566320:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932227712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612525.566332:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932228224:0@lo:400:kworker.0 00000001:00100000:2.0:1788612525.566355:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000020:00000080:2.0:1788612525.566360:0:8434:0:(genops.c:885:class_export_put()) final put ffff9611c7931800/449720ee-67e1-48cb-85d0-ee79593410d8 00000020:00000080:1.0:1788612525.566366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7937800/449720ee-67e1-48cb-85d0-ee79593410d8 for lustre-OST0001 00010000:00080000:2.0:1788612525.566417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc7800 x1875495932228992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788612525.566421:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7931800/449720ee-67e1-48cb-85d0-ee79593410d8 for lustre-OST0000 00000100:00100000:2.0:1788612525.566431:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932228992:0@lo:400:kworker.0 00000020:00000080:1.0:1788612525.566446:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7934800 for lustre-OST0001 00000020:00000080:1.0:1788612525.566454:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7936000 for lustre-OST0000 00000100:00100000:2.0:1788612525.566456:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932227968:0@lo:400:kworker.0 00010000:00080000:2.0:1788612525.566470:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4a80 x1875495932228480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612525.566638:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932228480:0@lo:400:kworker.0 00000100:00080000:0.0:1788612525.571553:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612525.571566:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612525.571571:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612525.571575:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612525.578579:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932227456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 19123us (23781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612525.578597:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788612525.584629:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b9c00 x1875495932227456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612525.584663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932227456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612526.063655:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612526.063677:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612526.063750:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612526.063821:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229248 00000100:00100000:1.0:1788612526.063828:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229248 00000100:00100000:1.0:1788612526.063884:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612526.063894:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932229248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612526.063931:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612526.063975:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932229248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612526.063981:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788612526.064019:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7840a80 x1875495932229248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612526.064036:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612526.066009:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932229376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612526.066076:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612526.069651:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229376 00000100:00100000:0.0:1788612526.069664:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229376 00000100:00100000:0.0:1788612526.069715:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788612526.069724:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932229376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612526.069757:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612526.069831:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932229376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612526.069839:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612526.070155:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932229376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612526.070230:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932229504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612526.070270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612526.070589:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229504 00000100:00100000:1.0:1788612526.070594:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229504 00000100:00100000:1.0:1788612526.070636:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612526.070644:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932229504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612526.070658:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612526.070696:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932229504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612526.070703:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788612526.070746:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7842680 x1875495932229504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612526.070760:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932229504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612526.451209:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612527.477846:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612527.617314:0:13043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788612528.495766:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612529.137624:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612529.137657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932229632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612529.137733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612529.137806:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229632 00000100:00100000:0.0:1788612529.137812:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229632 00000100:00100000:0.0:1788612529.137862:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788612529.137871:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932229632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612529.137915:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612529.137961:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932229632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612529.137979:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788612529.138030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932229632:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612529.519660:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612529.753848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612529.753904:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612529.753937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612529.753962:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612529.753996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612529.754006:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325632 00000100:00100000:3.0:1788612529.754023:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325632 00000100:00100000:2.0:1788612529.754090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325376 00000100:00100000:2.0:1788612529.754100:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325376 00000100:00100000:3.0:1788612529.754116:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325888 00000100:00100000:3.0:1788612529.754123:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325888 00000100:00100000:3.0:1788612529.754154:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325504 00000100:00100000:2.0:1788612529.754162:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:2.0:1788612529.754178:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914325376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612529.754180:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325504 00000100:00100000:3.0:1788612529.754208:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325760 00000100:00100000:3.0:1788612529.754213:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325760 00000100:00100000:3.0:1788612529.754243:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:3.0:1788612529.754255:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914325632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612529.754277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914325376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 103us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612529.754288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:3.0:1788612529.754344:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914325632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 90us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.754352:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:3.0:1788612529.754378:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:3.0:1788612529.754387:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914325888:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612529.754422:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914325888:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.754428:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:3.0:1788612529.754460:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:3.0:1788612529.754470:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914325504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612529.754560:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914325504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 92us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.754567:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:3.0:1788612529.754580:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:3.0:1788612529.754587:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914325760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612529.754624:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914325760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.754630:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00080000:0.0:1788612529.755405:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612529.755412:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788612530.544717:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612530.672305:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932229760:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672371:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672419:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932230400:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672446:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672463:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932230784:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672548:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672568:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932231296:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672589:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672612:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788612530.672619:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932229888:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672643:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932230272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612530.672681:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672695:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932230912:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672714:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672729:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932231424:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672751:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672784:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932230016:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672805:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672819:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932230528:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672857:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.672894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932231040:0@lo:400:kworker.0 00000100:00100000:2.0:1788612530.672915:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229760 00000100:00100000:1.0:1788612530.672924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612530.672930:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229760 00000100:00100000:1.0:1788612530.672951:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788612530.672959:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932230144:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.672985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612530.673008:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788612530.673010:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932230656:0@lo:400:kworker.0 00000100:00100000:2.0:1788612530.673025:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932229760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.673036:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.673053:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932231168:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.673084:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612530.675904:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230400 00000100:00100000:0.0:1788612530.675914:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230400 00000100:00100000:0.0:1788612530.675956:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230016 00000100:00100000:0.0:1788612530.675959:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230016 00000100:00100000:0.0:1788612530.675979:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788612530.675988:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932230400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676218:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612530.676232:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932231552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612530.676277:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.676326:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230784 00000100:00100000:1.0:1788612530.676330:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230784 00000100:00100000:1.0:1788612530.676367:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231296 00000100:00100000:1.0:1788612530.676370:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231296 00000100:00100000:1.0:1788612530.676385:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230912 00000100:00100000:1.0:1788612530.676388:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230912 00000100:00100000:1.0:1788612530.676403:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231424 00000100:00100000:1.0:1788612530.676405:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231424 00000100:00100000:1.0:1788612530.676420:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788612530.676426:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932230784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676468:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932230784:12345-0@lo:400:kworker.0 Request processed in 41us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676490:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788612530.676506:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612530.676526:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932231296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676563:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932231296:12345-0@lo:400:kworker.0 Request processed in 37us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676568:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612530.676579:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788612530.676585:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932230912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676610:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932230912:12345-0@lo:400:kworker.0 Request processed in 26us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676616:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788612530.676625:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788612530.676630:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932231424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676653:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932231424:12345-0@lo:400:kworker.0 Request processed in 23us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676660:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788612530.676679:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932229888 00000100:00100000:1.0:1788612530.676683:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932229888 00000100:00100000:1.0:1788612530.676698:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230528 00000100:00100000:1.0:1788612530.676701:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230528 00000100:00100000:1.0:1788612530.676710:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231040 00000100:00100000:1.0:1788612530.676712:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231040 00000100:00100000:1.0:1788612530.676720:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230144 00000100:00100000:1.0:1788612530.676723:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230144 00000100:00100000:1.0:1788612530.676731:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230656 00000100:00100000:1.0:1788612530.676733:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230656 00000100:00100000:1.0:1788612530.676743:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231168 00000100:00100000:1.0:1788612530.676745:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231168 00000100:00100000:1.0:1788612530.676758:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788612530.676764:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932229888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676803:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932229888:12345-0@lo:400:kworker.0 Request processed in 38us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676809:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788612530.676819:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788612530.676825:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932230528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676851:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932230528:12345-0@lo:400:kworker.0 Request processed in 27us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676857:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788612530.676884:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788612530.676890:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932231040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676917:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932231040:12345-0@lo:400:kworker.0 Request processed in 27us (3996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676922:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788612530.676932:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788612530.676937:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932230144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.676962:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932230144:12345-0@lo:400:kworker.0 Request processed in 25us (3977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.676967:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788612530.676976:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788612530.676980:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932230656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.677003:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932230656:12345-0@lo:400:kworker.0 Request processed in 23us (3968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.677008:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788612530.677017:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788612530.677023:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932231168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.677068:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932231168:12345-0@lo:400:kworker.0 Request processed in 46us (3984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.677074:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788612530.683947:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932230272 00000100:00100000:1.0:1788612530.683961:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932230272 00000100:00100000:1.0:1788612530.684028:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231552 00000100:00100000:1.0:1788612530.684032:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231552 00000100:00100000:1.0:1788612530.684051:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612530.684060:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932230272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788612530.684092:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612530.684162:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932230272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (11479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.684169:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612530.684184:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788612530.684191:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932231552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612530.684201:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612530.684229:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932231552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (7951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.684235:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788612530.684274:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb852a00 x1875495932231552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684292:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932231552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612530.684330:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932229888:0@lo:400:kworker.0 00010000:00080000:1.0:1788612530.684341:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b9c00 x1875495932230272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684372:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932230272:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788612530.684387:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864a80 x1875495932230912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684396:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932230912:0@lo:400:kworker.0 00010000:00080000:1.0:1788612530.684405:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4700 x1875495932231424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932231424:0@lo:400:kworker.0 00010000:00080000:1.0:1788612530.684424:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7866d80 x1875495932230784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684432:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932230784:0@lo:400:kworker.0 00010000:00080000:1.0:1788612530.684442:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc5c00 x1875495932231296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932231296:0@lo:400:kworker.0 00010000:00080000:1.0:1788612530.684508:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc7800 x1875495932231168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684517:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932231168:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.684530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932230528:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.684540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932231040:0@lo:400:kworker.0 00000100:00100000:1.0:1788612530.684558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932230144:0@lo:400:kworker.0 00010000:00080000:1.0:1788612530.684568:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864e00 x1875495932230656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612530.684583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932230656:0@lo:400:kworker.0 00000100:00080000:1.0:1788612530.684658:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612530.684662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612530.684665:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612530.684667:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612530.696071:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932229760:12345-0@lo:400:kworker.0 Request processed in 23038us (23686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612530.696094:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788612530.696199:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932229760:0@lo:400:kworker.0 00000100:00100000:0.0:1788612530.697265:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932230400:12345-0@lo:400:kworker.0 Request processed in 21269us (24809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.697280:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788612530.697324:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788612530.697335:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932230016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612530.697400:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932230016:12345-0@lo:400:kworker.0 Request processed in 69us (24593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.697407:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788612530.697452:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932230016:0@lo:400:kworker.0 00000100:00100000:3.0:1788612530.698808:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932230400:0@lo:400:kworker.0 00000100:00100000:1.0:1788612531.183624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932231680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612531.183688:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612531.183751:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231680 00000100:00100000:1.0:1788612531.183758:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231680 00000100:00100000:1.0:1788612531.183811:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612531.183821:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932231680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612531.183847:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612531.183897:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932231680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612531.183904:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788612531.183942:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7883b80 x1875495932231680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612531.183959:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932231680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612531.184552:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932231808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612531.184583:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612531.184666:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231808 00000100:00100000:3.0:1788612531.184672:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231808 00000100:00100000:3.0:1788612531.184705:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788612531.184713:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932231808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612531.184725:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612531.184757:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932231808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.184764:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788612531.184830:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1fb80 x1875495932231808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612531.184843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932231808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612531.185710:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612531.185721:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932231936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612531.185756:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612531.185881:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932231936 00000100:00100000:0.0:1788612531.185886:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932231936 00000100:00100000:0.0:1788612531.185939:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612531.185947:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932231936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612531.185970:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612531.186011:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932231936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612531.186018:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612531.186051:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932231936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612531.573618:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612532.396846:0:13190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe807a0320 20000000:00000080:0.0:1788612532.396877:0:13190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9611c66fe800 uarg=0000000000000000 20000000:01000000:0.0:1788612532.396921:0:13190:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788612532.396927:0:13190:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788612532.396931:0:13190:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788612532.397397:0:13191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788612532.397659:0:13190:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788612532.407055:0:13190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788612532.407087:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407105:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407114:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407120:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407236:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407246:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407271:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407278:0:13190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407322:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407339:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 12 pid: 6518 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.407353:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232064:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612532.407514:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407524:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 12 pid: 6517 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.407532:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232192:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612532.407564:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407572:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 23 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.407580:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232320:0@lo:104: 00000100:00100000:0.0:1788612532.407616:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612532.407672:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932232320 00000100:00100000:0.0:1788612532.407679:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932232320 00000100:00100000:0.0:1788612532.407722:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612532.407730:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232320:12345-0@lo:104: 00010000:00010000:0.0:1788612532.407742:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407792:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612532.407798:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232320:12345-0@lo:104: Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612532.407804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788612532.407836:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407845:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 23 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.407864:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232448:0@lo:104: 00000100:00100000:0.0:1788612532.407889:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612532.407909:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932232448 00000100:00100000:0.0:1788612532.407913:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932232448 00000100:00100000:0.0:1788612532.407930:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788612532.407936:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232448:12345-0@lo:104: 00010000:00010000:0.0:1788612532.407944:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.407977:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612532.407982:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232448:12345-0@lo:104: Request processed in 46us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612532.407996:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788612532.408023:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.408031:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 23 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.408040:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232576:0@lo:104: 00000100:00100000:0.0:1788612532.408063:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612532.408081:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932232576 00000100:00100000:0.0:1788612532.408084:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932232576 00000100:00100000:0.0:1788612532.408100:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788612532.408105:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232576:12345-0@lo:104: 00010000:00010000:0.0:1788612532.408112:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408266:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612532.408273:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408281:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612532.408285:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408293:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612532.408300:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612532.408306:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612532.408345:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408359:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612532.408381:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408388:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc80a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc80a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408400:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612532.408404:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408409:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612532.408411:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408417:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612532.408422:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612532.408427:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612532.408440:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408445:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612532.408450:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408455:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc8092 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8099 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.408469:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.408471:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.408473:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.408493:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612532.408504:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932232704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612532.408533:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612532.408559:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612532.408565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932232832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612532.408586:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612532.408615:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932232704 00000100:00100000:3.0:1788612532.408618:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932232704 00010000:00010000:3.0:1788612532.408635:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 24 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612532.408654:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932232832 00000100:00100000:3.0:1788612532.408658:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932232832 00010000:00010000:0.0:1788612532.408759:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612532.408765:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232576:12345-0@lo:104: Request processed in 659us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612532.408771:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1788612532.408800:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.408809:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 25 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.408818:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232960:0@lo:104: 00000100:00100000:0.0:1788612532.408841:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612532.408899:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 25 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612532.408917:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612532.408980:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612532.409330:0:13190:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612532.409351:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232320:0@lo:104: 00000100:00100000:0.0:1788612532.409363:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232448:0@lo:104: 00000100:00100000:0.0:1788612532.409368:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232576:0@lo:104: 00000100:00100000:3.0:1788612532.409459:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3648:x1875495932232704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612532.409472:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788612532.409637:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932232960 00000100:00100000:0.0:1788612532.409642:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932232960 00010000:00010000:3.0:1788612532.409754:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 25 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409763:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 25 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409787:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc80a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc80a0 expref: 25 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409799:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612532.409834:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932232704:12345-0@lo:103:ldlm_bl.0 Request processed in 911us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612532.409840:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788612532.409867:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612532.409872:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409879:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612532.409882:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409888:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612532.409895:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612532.409900:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612532.409924:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409930:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612532.409946:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409952:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc8084 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc808b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.409967:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.409969:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.409971:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612532.409990:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932232704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612532.410012:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932233088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612532.410039:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612532.410069:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233088 00000100:00100000:3.0:1788612532.410073:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233088 00010000:00010000:3.0:1788612532.410088:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 24 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612532.410108:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612532.410114:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932233088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612532.410121:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612532.410125:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 24 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.410207:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788612532.410215:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232960:12345-0@lo:104: 00010000:00010000:0.0:1788612532.410225:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612532.410264:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612532.410270:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13190:x1875495932232960:12345-0@lo:104: Request processed in 57us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612532.410276:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788612532.410312:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 24 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410322:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1a00/0x1f8616bf0bc808b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc8084 expref: 24 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410331:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612532.410358:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932233088:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612532.410365:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1788612532.410386:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612532.410391:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410397:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612532.410400:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410407:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612532.410413:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612532.410418:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612532.410433:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410439:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612532.410449:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410454:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f4200/0x1f8616bf0bc8076 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc807d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410467:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.410469:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612532.410470:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612532.410502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932233088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612532.410513:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612532.410518:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932233216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612532.410546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612532.410571:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233216 00000100:00100000:3.0:1788612532.410574:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233216 00010000:00010000:3.0:1788612532.410587:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 23 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612532.410605:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612532.410611:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932233216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612532.410619:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612532.410623:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 23 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410632:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 23 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.410642:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612532.410737:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932233216:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612532.410744:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612532.410777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932233216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612532.410847:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:3648:x1875495932232832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612532.410869:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612532.410874:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 22 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612532.410882:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 22 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612532.410892:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1800/0x1f8616bf0bc8099 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc8092 expref: 22 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612532.410901:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612532.410938:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3648:x1875495932232832:12345-0@lo:103:ldlm_bl.0 Request processed in 1945us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612532.410944:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788612532.411009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932232832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612532.411206:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3800/0x1f8616bf0bc807d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc8076 expref: 20 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612532.411217:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232960:0@lo:104: 00000100:00100000:2.0:1788612532.413302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612532.413340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612532.413398:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326016 00000100:00100000:3.0:1788612532.413406:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326016 00010000:00010000:3.0:1788612532.413449:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 13 pid: 6518 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612532.413504:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326144 00000100:00100000:3.0:1788612532.413507:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326144 00010000:00010000:3.0:1788612532.413535:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 14 pid: 6517 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612532.413556:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1788612532.413565:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4a7b63b-1ca3-448d-b4ff-632109d126dc+14:2395:x1875495914326016:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612532.413577:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612532.413582:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 14 pid: 6518 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413593:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 14 pid: 6518 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413609:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612532.413649:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4a7b63b-1ca3-448d-b4ff-632109d126dc+14:2395:x1875495914326016:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612532.413657:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1788612532.413683:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1788612532.413690:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9286450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914326144:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612532.413697:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612532.413701:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 13 pid: 6517 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413711:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 13 pid: 6517 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413722:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413730:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413751:0:10342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413758:0:10342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413764:0:10342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413771:0:10342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413776:0:10342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612532.413780:0:10342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413787:0:10342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413795:0:10342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.413806:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612532.413826:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9286450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914326144:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 137us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612532.413833:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00010000:00010000:1.0:1788612532.416802:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc80c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2209a expref: 12 pid: 6518 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612532.416826:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232064:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612532.416839:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc80ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2205b expref: 11 pid: 6517 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612532.416850:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1875495932232192:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612532.416897:0:13190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612532.416907:0:13190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612532.416933:0:13190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612532.416940:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe925800/0x1f8616bf0bc80e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612532.594806:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612533.630348:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612533.871640:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612533.871649:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c67e2000 from 7 10000000:01000000:3.0:1788612533.871669:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612533.871715:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.871729:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.871741:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.871767:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.871831:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612533.871904:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c68c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612533.872017:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233344 00000100:00100000:2.0:1788612533.872024:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233344 00000100:00100000:2.0:1788612533.872077:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788612533.872086:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932233344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612533.872098:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.872113:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc80ed expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.872135:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.872145:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.872167:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030800, rc 0) 00000100:00100000:2.0:1788612533.872218:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932233344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.872225:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788612533.872315:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612533.872332:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.872341:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.872416:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.872467:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612533.872517:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612533.872626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233472 00000100:00100000:2.0:1788612533.872631:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233472 00000100:00100000:2.0:1788612533.872665:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788612533.872672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932233472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612533.872778:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932233472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.872786:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788612533.872954:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.872984:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.873024:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612533.873045:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612533.873094:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233600 00000100:00100000:2.0:1788612533.873098:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233600 00000100:00100000:2.0:1788612533.873127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788612533.873133:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932233600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612533.873204:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932233600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.873211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788612533.875761:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612533.880325:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788612533.880691:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788612533.880715:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612533.880726:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.880737:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612533.880747:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612533.880750:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fcfb4000 from 7 10000000:01000000:0.0:1788612533.880753:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612533.880789:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.880797:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.880808:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.880831:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.880921:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612533.880968:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612533.881033:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233728 00000100:00100000:2.0:1788612533.881040:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233728 00000100:00100000:2.0:1788612533.881088:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788612533.881097:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932233728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612533.881110:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.881121:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc80fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.881157:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.881168:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.881177:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030200, rc 0) 00000100:00100000:2.0:1788612533.881227:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932233728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.881243:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788612533.883265:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612533.883292:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.883304:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.883380:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.883443:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612533.883503:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c68c1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612533.883793:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233856 00000100:00100000:1.0:1788612533.883800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233856 00000100:00100000:1.0:1788612533.883856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788612533.883866:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932233856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.883986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932233856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612533.883994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788612533.884031:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.884064:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.884103:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612533.884123:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612533.885135:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932233984 00000100:00100000:1.0:1788612533.885144:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932233984 00000100:00100000:1.0:1788612533.885180:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788612533.885188:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932233984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.885312:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932233984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612533.885319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788612533.885382:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932233984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612533.894730:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788612533.895281:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788612533.895305:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612533.895317:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.895329:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612533.895341:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612533.895343:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fccf8000 from 7 10000000:01000000:1.0:1788612533.895346:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612533.895395:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.895403:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.895413:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.895446:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.895528:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612533.895568:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612533.895720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234112 00000100:00100000:3.0:1788612533.895727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234112 00000100:00100000:3.0:1788612533.895774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788612533.895783:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932234112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612533.895808:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612533.895821:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8109 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.895854:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.895866:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.895874:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3600, rc 0) 00000100:00100000:3.0:1788612533.895913:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932234112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.895920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788612533.896456:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612533.896472:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.896505:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.896584:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.896615:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612533.896640:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612533.896757:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234240 00000100:00100000:3.0:1788612533.896762:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234240 00000100:00100000:3.0:1788612533.896798:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788612533.896805:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932234240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.896923:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932234240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.896930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788612533.900571:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.900639:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612533.900715:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612533.900748:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612533.900946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234368 00000100:00100000:0.0:1788612533.900953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234368 00000100:00100000:0.0:1788612533.901005:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788612533.901015:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932234368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.901137:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932234368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612533.901146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788612533.902061:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788612533.904097:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788612533.904789:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788612533.904819:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612533.904831:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.904841:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612533.904861:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612533.904863:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c7237000 from 7 10000000:01000000:0.0:1788612533.904866:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612533.904904:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.904912:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.904923:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.904946:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.905026:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612533.905068:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612533.905123:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234496 00000100:00100000:1.0:1788612533.905130:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234496 00000100:00100000:1.0:1788612533.905344:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788612533.905355:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932234496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612533.905383:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612533.905396:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8117 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.905667:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.905680:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.905688:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a600, rc 0) 00000100:00100000:1.0:1788612533.905730:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932234496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 377us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612533.905744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788612533.906410:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612533.906685:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.906696:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.906766:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612533.906803:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612533.907545:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612533.914101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234624 00000100:00100000:3.0:1788612533.914115:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234624 00000100:00100000:3.0:1788612533.914170:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788612533.914180:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932234624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.914351:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932234624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (7546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.914628:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788612533.914692:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.914754:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.914798:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612533.914830:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c68c1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612533.914855:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234752 00000100:00100000:3.0:1788612533.914859:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234752 00000100:00100000:3.0:1788612533.914884:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788612533.914891:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932234752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612533.914969:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932234752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.914977:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788612533.915014:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932234752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612533.919865:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788612533.934461:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788612533.934519:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612533.934531:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.934543:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.231207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612534.231339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326272 00000100:00100000:3.0:1788612534.231349:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326272 00000100:00100000:3.0:1788612534.231408:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 326 00000100:00100000:3.0:1788612534.231418:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:6166:x1875495914326272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612534.231434:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612534.231453:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.231526:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.231557:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.231566:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2200, rc 0) 00000100:00100000:3.0:1788612534.231621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914326272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 205us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.231628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 326 00000100:00100000:3.0:1788612534.233990:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612534.234226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326400 00000100:00100000:2.0:1788612534.234243:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326400 00000100:00100000:2.0:1788612534.234295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 327 00000100:00100000:2.0:1788612534.234304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914326400:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612534.234446:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914326400:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 142us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612534.234454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 327 00000100:00100000:2.0:1788612534.236540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612534.236636:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326528 00000100:00100000:0.0:1788612534.236645:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326528 00000100:00100000:0.0:1788612534.236698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 328 00000100:00100000:0.0:1788612534.236708:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914326528:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612534.236827:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914326528:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.236835:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 328 00000100:00100000:0.0:1788612534.253885:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612534.254074:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326656 00000100:00100000:3.0:1788612534.254082:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326656 00000100:00100000:3.0:1788612534.254148:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:3.0:1788612534.254159:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914326656:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612534.254176:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612534.254193:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220d2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.254220:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.254231:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.254240:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3a00, rc 0) 00000100:00100000:3.0:1788612534.254300:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914326656:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 142us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.254307:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:1.0:1788612534.255878:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612534.255899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932234880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612534.255955:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612534.256064:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932234880 00000100:00100000:0.0:1788612534.256071:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932234880 00000100:00100000:0.0:1788612534.256119:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612534.256128:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932234880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612534.256168:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612534.256217:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932234880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.256235:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788612534.256745:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932234880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612534.257925:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612534.265213:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326784 00000100:00100000:0.0:1788612534.265225:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326784 00000100:00100000:0.0:1788612534.265268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 330 00000100:00100000:0.0:1788612534.265277:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914326784:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612534.265417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914326784:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 140us (7497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.265425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 330 00000100:00100000:2.0:1788612534.273797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612534.275433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326912 00000100:00100000:0.0:1788612534.275447:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326912 00000100:00100000:0.0:1788612534.275540:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 331 00000100:00100000:0.0:1788612534.275552:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914326912:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612534.275694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914326912:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 144us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.275702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 331 00010000:00010000:0.0:1788612534.651791:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612534.872404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612534.872447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612534.872505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612534.872529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612534.872925:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327168 00000100:00100000:1.0:1788612534.872934:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327168 00000100:00100000:1.0:1788612534.872995:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327424 00000100:00100000:1.0:1788612534.872999:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327424 00000100:00100000:1.0:1788612534.873012:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327040 00000100:00100000:1.0:1788612534.873015:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327040 00000100:00100000:1.0:1788612534.873024:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327296 00000100:00100000:1.0:1788612534.873026:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327296 00000100:00100000:1.0:1788612534.873043:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1788612534.873051:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914327168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612534.873117:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914327168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612534.873125:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1788612534.873141:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:1.0:1788612534.873147:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914327424:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612534.873170:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914327424:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612534.873176:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:1.0:1788612534.873187:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1788612534.873194:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914327040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612534.873216:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914327040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612534.873242:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1788612534.873256:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1788612534.873263:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914327296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612534.873288:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914327296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612534.873294:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00080000:0.0:1788612534.873918:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612534.873923:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788612535.663703:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612535.791930:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932235392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792101:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932235008:0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792157:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.792206:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932235520:0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792247:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.792267:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932236032:0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.792304:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932236544:0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.792352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235008 00000100:00100000:2.0:1788612535.792359:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235008 00000100:00100000:2.0:1788612535.792397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788612535.792405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792448:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932235008:12345-0@lo:400:kworker.0 Request processed in 43us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.792455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788612535.792512:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235520 00000100:00100000:2.0:1788612535.792517:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235520 00000100:00100000:2.0:1788612535.792543:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788612535.792550:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932235520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.792581:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932235520:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.792587:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788612535.792617:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236032 00000100:00100000:2.0:1788612535.792620:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236032 00000100:00100000:0.0:1788612535.792915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932235136:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.792948:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.792985:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932235648:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.793014:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.793032:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932236160:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.793052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.793069:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932236672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612535.793090:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.793109:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788612535.793115:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932235264:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.793136:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.793153:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932235776:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.793172:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.793189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932236288:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.793206:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.793375:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236544 00000100:00100000:2.0:1788612535.793380:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236544 00000100:00100000:2.0:1788612535.793406:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612535.793415:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932236032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.793452:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932236032:12345-0@lo:400:kworker.0 Request processed in 39us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.793459:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788612535.793562:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932236800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612535.793590:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.793623:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236672 00000100:00100000:0.0:1788612535.793626:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236672 00000100:00100000:0.0:1788612535.793733:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236800 00000100:00100000:0.0:1788612535.793738:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236800 00000100:00100000:0.0:1788612535.793753:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612535.793759:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932236672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612535.793781:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612535.793818:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932236672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.793824:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612535.793852:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612535.793859:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932236800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612535.793877:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612535.793905:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932236800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.793910:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612535.793929:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235136 00000100:00100000:0.0:1788612535.793933:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235136 00000100:00100000:0.0:1788612535.793950:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235648 00000100:00100000:0.0:1788612535.793953:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235648 00000100:00100000:0.0:1788612535.793981:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236160 00000100:00100000:0.0:1788612535.793984:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236160 00000100:00100000:0.0:1788612535.793996:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235776 00000100:00100000:0.0:1788612535.793998:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235776 00000100:00100000:0.0:1788612535.794008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236288 00000100:00100000:0.0:1788612535.794010:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236288 00000100:00100000:0.0:1788612535.794024:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788612535.794030:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932235136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.794061:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932235136:12345-0@lo:400:kworker.0 Request processed in 31us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.794067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788612535.794077:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788612535.794082:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.794111:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932235648:12345-0@lo:400:kworker.0 Request processed in 29us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.794117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788612535.794129:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788612535.794135:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932236160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.794160:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932236160:12345-0@lo:400:kworker.0 Request processed in 25us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.794172:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788612535.794184:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788612535.794190:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932235776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.794217:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932235776:12345-0@lo:400:kworker.0 Request processed in 28us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.794350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612535.794371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932235904:0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.794398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612535.794409:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932236416:0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.794427:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612535.794459:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235392 00000100:00100000:1.0:1788612535.794463:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235392 00000100:00100000:2.0:1788612535.794611:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235904 00000100:00100000:2.0:1788612535.794615:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235904 00000100:00100000:2.0:1788612535.794635:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236416 00000100:00100000:2.0:1788612535.794638:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236416 00000100:00100000:2.0:1788612535.795338:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612535.795347:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932236544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.795402:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932236544:12345-0@lo:400:kworker.0 Request processed in 56us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.795408:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612535.795425:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788612535.795431:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932235904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.795576:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932235904:12345-0@lo:400:kworker.0 Request processed in 145us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.795583:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788612535.795595:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788612535.795602:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932236416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.795635:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932236416:12345-0@lo:400:kworker.0 Request processed in 33us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.795736:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788612535.795864:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788612535.795897:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932235264 00000100:00100000:2.0:1788612535.795904:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932235264 00000100:00100000:2.0:1788612535.795924:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788612535.795930:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932235264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612535.795981:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932235264:12345-0@lo:400:kworker.0 Request processed in 51us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.795987:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788612535.796003:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612535.796008:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612535.796010:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612535.796013:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612535.804374:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788612535.804400:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932236288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.804516:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932236288:12345-0@lo:400:kworker.0 Request processed in 130us (11307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.804524:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788612535.804544:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788612535.804551:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932235392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.804585:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932235392:12345-0@lo:400:kworker.0 Request processed in 35us (10235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.804591:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788612535.807843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932235264:0@lo:400:kworker.0 00010000:00080000:1.0:1788612535.807866:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880380 x1875495932235776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612535.807877:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932235776:0@lo:400:kworker.0 00010000:00080000:1.0:1788612535.807890:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb850000 x1875495932236288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612535.807898:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932236288:0@lo:400:kworker.0 00010000:00080000:1.0:1788612535.807910:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed5a680 x1875495932236800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612535.807929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932236800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612535.807942:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932235136:0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.807952:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932235648:0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.807976:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932236160:0@lo:400:kworker.0 00010000:00080000:1.0:1788612535.807989:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79b9c00 x1875495932236672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612535.808000:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932236672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612535.809138:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932235008:0@lo:400:kworker.0 00000100:00100000:1.0:1788612535.809155:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932235520:0@lo:400:kworker.0 00010000:00080000:1.0:1788612535.809169:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb853480 x1875495932236032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612535.809179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932236032:0@lo:400:kworker.0 00010000:00080000:1.0:1788612535.809200:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4a80 x1875495932236544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612535.809209:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932236544:0@lo:400:kworker.0 00000100:00100000:0.0:1788612535.810188:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932235392:0@lo:400:kworker.0 00010000:00080000:0.0:1788612535.810205:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb851180 x1875495932235904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612535.810215:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932235904:0@lo:400:kworker.0 00010000:00080000:0.0:1788612535.810235:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fb853b80 x1875495932236416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612535.810243:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932236416:0@lo:400:kworker.0 00000100:00100000:3.0:1788612536.303714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932237184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612536.303774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612536.303859:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237184 00000100:00100000:3.0:1788612536.303865:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237184 00000100:00100000:3.0:1788612536.303905:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788612536.303912:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932237184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612536.303936:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612536.303974:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932237184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612536.303980:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788612536.304015:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bc000 x1875495932237184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612536.304031:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932237184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612536.309097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932236928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612536.309171:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612536.309224:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612536.309232:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932237056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612536.309258:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612536.309296:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932236928 00000100:00100000:0.0:1788612536.309303:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932236928 00000100:00100000:0.0:1788612536.309349:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788612536.309358:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932236928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612536.309387:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612536.309439:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932236928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612536.309446:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788612536.309601:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237056 00000100:00100000:0.0:1788612536.309605:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237056 00000100:00100000:0.0:1788612536.309634:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788612536.309641:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932237056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612536.309666:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612536.309699:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932237056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612536.309705:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788612536.309748:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932237056:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1788612536.309763:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4a80 x1875495932236928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612536.309776:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932236928:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788612536.689803:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612537.715418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612538.564948:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788612538.735659:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612539.379765:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612539.379789:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932237312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612539.379867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612539.381300:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237312 00000100:00100000:0.0:1788612539.381313:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237312 00000100:00100000:0.0:1788612539.381386:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788612539.381397:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932237312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612539.381432:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612539.381545:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932237312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612539.381553:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788612539.381654:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932237312:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788612539.759674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612539.998544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612539.998601:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612539.998644:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612539.998673:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612539.998722:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612539.998749:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327808 00000100:00100000:1.0:1788612539.998758:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327808 00000100:00100000:1.0:1788612539.998818:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328064 00000100:00100000:1.0:1788612539.998821:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328064 00000100:00100000:1.0:1788612539.998837:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327680 00000100:00100000:1.0:1788612539.998840:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327680 00000100:00100000:1.0:1788612539.998851:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327936 00000100:00100000:1.0:1788612539.998853:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327936 00000100:00100000:1.0:1788612539.998869:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1788612539.998878:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914327808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612539.998945:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914327808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.998953:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1788612539.998970:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:1.0:1788612539.999654:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914328064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612539.999687:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914328064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612540.001505:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327552 00000100:00100000:2.0:1788612540.001518:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327552 00000100:00100000:2.0:1788612540.001578:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:2.0:1788612540.001589:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914327552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612540.001667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914327552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612540.001675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00080000:2.0:1788612540.001710:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612540.001715:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612540.007462:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:0.0:1788612540.007515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914327680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612540.007605:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914327680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 101us (8930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612540.007621:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:0.0:1788612540.007657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:0.0:1788612540.007665:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914327936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612540.007694:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914327936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (8972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612540.007700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:1.0:1788612540.009919:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00010000:00010000:0.0:1788612540.783692:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612540.911721:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932237440:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.911790:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.911843:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932237952:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.911868:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.911888:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932238464:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.911911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.911929:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932238976:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.911950:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.911973:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788612540.911980:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932237568:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912003:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912021:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932238080:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912040:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912057:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932238592:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912104:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912126:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912143:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932238208:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912163:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912318:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932238720:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912356:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912377:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612540.912382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932237824:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912401:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912550:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932238336:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.912575:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.912593:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932238848:0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.912732:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237568 00000100:00100000:3.0:1788612540.912739:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237568 00000100:00100000:3.0:1788612540.912774:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238080 00000100:00100000:3.0:1788612540.912777:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238080 00000100:00100000:3.0:1788612540.912809:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238592 00000100:00100000:3.0:1788612540.912812:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238592 00000100:00100000:3.0:1788612540.912825:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238208 00000100:00100000:3.0:1788612540.912827:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238208 00000100:00100000:3.0:1788612540.912836:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238720 00000100:00100000:3.0:1788612540.912839:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238720 00000100:00100000:3.0:1788612540.912848:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237824 00000100:00100000:3.0:1788612540.912850:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237824 00000100:00100000:3.0:1788612540.912863:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788612540.912871:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932237568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.917930:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932237568:12345-0@lo:400:kworker.0 Request processed in 5048us (5914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.917957:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788612540.917993:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788612540.918003:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932238080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.918051:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932238080:12345-0@lo:400:kworker.0 Request processed in 51us (6009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.918057:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788612540.918070:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788612540.918077:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932238592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.918106:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932238592:12345-0@lo:400:kworker.0 Request processed in 29us (6029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.918112:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788612540.918123:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788612540.918130:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932238208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.918159:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932238208:12345-0@lo:400:kworker.0 Request processed in 30us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.918164:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788612540.918175:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788612540.918181:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932238720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.918220:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932238720:12345-0@lo:400:kworker.0 Request processed in 40us (5864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.918226:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788612540.918237:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788612540.918244:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932237824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.918271:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932237824:12345-0@lo:400:kworker.0 Request processed in 29us (5869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.918284:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1788612540.918307:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612540.918312:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612540.918320:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612540.918345:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932239232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612540.918385:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.923472:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612540.923556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237440 00000100:00100000:1.0:1788612540.923564:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237440 00000100:00100000:1.0:1788612540.923636:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788612540.923646:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932237440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.923697:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932237440:12345-0@lo:400:kworker.0 Request processed in 52us (11906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.923704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788612540.923737:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237952 00000100:00100000:1.0:1788612540.923741:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237952 00000100:00100000:1.0:1788612540.923760:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932237696 00000100:00100000:1.0:1788612540.923763:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932237696 00000100:00100000:1.0:1788612540.923775:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788612540.923781:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932237952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.923825:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932237952:12345-0@lo:400:kworker.0 Request processed in 44us (11955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.923832:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788612540.923843:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788612540.923848:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932237696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.923898:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932237696:12345-0@lo:400:kworker.0 Request processed in 50us (11772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.923904:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788612540.923934:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238464 00000100:00100000:1.0:1788612540.923938:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238464 00000100:00100000:1.0:1788612540.923966:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238976 00000100:00100000:1.0:1788612540.923968:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238976 00000100:00100000:1.0:1788612540.923980:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238336 00000100:00100000:1.0:1788612540.923982:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238336 00000100:00100000:1.0:1788612540.923994:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932238848 00000100:00100000:1.0:1788612540.923996:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932238848 00000100:00100000:1.0:1788612540.924009:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612540.924014:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932238464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.924044:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932238464:12345-0@lo:400:kworker.0 Request processed in 30us (12132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.924050:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788612540.924061:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788612540.924066:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932238976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.924094:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932238976:12345-0@lo:400:kworker.0 Request processed in 28us (12143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.924099:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788612540.924109:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612540.924115:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932238336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.924141:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932238336:12345-0@lo:400:kworker.0 Request processed in 26us (11565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.924147:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612540.924158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788612540.924172:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932238848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.924200:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932238848:12345-0@lo:400:kworker.0 Request processed in 29us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.924205:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788612540.927122:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239232 00000100:00100000:3.0:1788612540.927143:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239232 00000100:00100000:3.0:1788612540.927204:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788612540.927214:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932239232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612540.927242:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612540.927309:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932239232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (8922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.927315:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788612540.927336:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612540.927341:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612540.927358:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932239104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612540.927402:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612540.927453:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932237568:0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.927466:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932238080:0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.927497:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932238592:0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.927509:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932237440:0@lo:400:kworker.0 00000100:00100000:3.0:1788612540.927520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932237952:0@lo:400:kworker.0 00010000:00080000:3.0:1788612540.927539:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880380 x1875495932238464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612540.927559:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932238464:0@lo:400:kworker.0 00010000:00080000:3.0:1788612540.927571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7867100 x1875495932238976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612540.927584:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932238976:0@lo:400:kworker.0 00010000:00080000:3.0:1788612540.927633:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f4000 x1875495932239232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612540.927646:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932239232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612540.930587:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239104 00000100:00100000:0.0:1788612540.930602:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239104 00000100:00100000:0.0:1788612540.930672:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788612540.930683:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932239104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612540.930708:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612540.930788:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932239104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (3386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612540.930805:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788612540.932936:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864e00 x1875495932238848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612540.932954:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932238848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.932967:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932237696:0@lo:400:kworker.0 00010000:00080000:1.0:1788612540.932979:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7882a00 x1875495932238208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612540.932987:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932238208:0@lo:400:kworker.0 00010000:00080000:1.0:1788612540.932999:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7867b80 x1875495932238720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612540.933006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932238720:0@lo:400:kworker.0 00000100:00100000:1.0:1788612540.933039:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932237824:0@lo:400:kworker.0 00010000:00080000:1.0:1788612540.933050:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7882300 x1875495932238336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612540.933058:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932238336:0@lo:400:kworker.0 00010000:00080000:0.0:1788612540.933129:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bc000 x1875495932239104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612540.933148:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932239104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612541.423681:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788612541.423703:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932239488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612541.423780:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612541.423857:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239488 00000100:00100000:3.0:1788612541.423861:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932239360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612541.423866:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239488 00000100:00100000:3.0:1788612541.423887:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612541.423907:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612541.423917:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932239488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612541.423969:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612541.424026:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932239488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612541.424033:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788612541.424144:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239360 00000100:00100000:2.0:1788612541.424148:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239360 00000100:00100000:2.0:1788612541.424186:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612541.424201:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932239360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612541.424220:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612541.424252:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932239360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612541.424258:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612541.424690:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932239616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612541.424720:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612541.424879:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239616 00000100:00100000:0.0:1788612541.424884:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239616 00000100:00100000:0.0:1788612541.424927:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788612541.424935:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932239616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612541.424945:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612541.424976:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932239616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612541.424982:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788612541.425112:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7ad7480 x1875495932239616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612541.425130:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932239616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612541.426070:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932239488:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788612541.426086:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bdf80 x1875495932239360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612541.426099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932239360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788612541.809798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612542.832795:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612543.856499:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612544.496419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932239744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612544.496515:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612544.496707:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239744 00000100:00100000:1.0:1788612544.496716:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239744 00000100:00100000:1.0:1788612544.496779:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788612544.496790:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932239744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612544.496834:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788612544.496882:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932239744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612544.496889:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788612544.496973:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932239744:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788612544.636090:0:13539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:49:03 (1788612543) === 00010000:00010000:0.0:1788612544.879798:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612544.936628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612544.936674:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612544.937034:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328192 00000100:00100000:3.0:1788612544.937044:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328192 00000100:00100000:3.0:1788612544.937117:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1788612544.937128:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914328192:12345-192.168.203.30@tcp:41:mkdir.0 00000004:00000024:3.0:1788612544.937173:0:12327:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788612544.937263:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914328192:12345-192.168.203.30@tcp:41:mkdir.0 Request processed in 138us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612544.937284:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00080000:0.0:1788612544.937464:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612544.937737:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328320 00000100:00100000:2.0:1788612544.937743:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328320 00000100:00100000:2.0:1788612544.937789:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788612544.937798:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:10484:x1875495914328320:12345-192.168.203.30@tcp:700:mkdir.0 00000100:00100000:2.0:1788612544.937851:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:10484:x1875495914328320:12345-192.168.203.30@tcp:700:mkdir.0 Request processed in 54us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612544.937858:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788612544.940632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612544.940693:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328576 00000100:00100000:0.0:1788612544.940702:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328576 00000100:00100000:0.0:1788612544.940774:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612544.940784:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:10484:x1875495914328576:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:0.0:1788612544.940834:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612544.940856:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc7fd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22046 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612544.940874:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7f00) 00010000:00010000:0.0:1788612544.940884:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612544.940957:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612544.940986:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612544.940995:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612544.941007:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612544.941014:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612544.941020:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942412:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942436:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942447:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612544.942465:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024a109a9 reply state 00000000e9a05d1f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942505:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942513:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:2.0:1788612544.942515:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612544.942519:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788612544.942523:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788612544.942531:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942537:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942544:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942550:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612544.942554:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942561:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942586:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7a00) 00010000:00010000:2.0:1788612544.942587:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612544.942591:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942889:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8133 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612544.942909:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024a109a9 reply state 00000000e9a05d1f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942918:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.942924:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9611c65f7800) 00010000:00010000:2.0:1788612544.942926:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612544.942928:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788612544.943024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:10484:x1875495914328576:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 2237us (2396us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788612544.943033:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612544.961782:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612544.961879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328704 00000100:00100000:1.0:1788612544.961890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328704 00000100:00100000:1.0:1788612544.961950:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612544.961962:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:10485:x1875495914328704:12345-192.168.203.30@tcp:101:chmod.0 00010000:00010000:1.0:1788612544.961987:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612544.962014:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220d9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.962079:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc814f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.962094:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc814f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.962105:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc814f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612544.962153:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612544.962156:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612544.962204:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc814f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.962229:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d9 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.962262:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc814f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d9 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.962270:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a600) 00010000:00010000:1.0:1788612544.962273:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612544.962277:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a800, rc 0) 00000100:00100000:1.0:1788612544.962337:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:10485:x1875495914328704:12345-192.168.203.30@tcp:101:chmod.0 Request processed in 377us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612544.962343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1788612544.968826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612544.968917:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328960 00000100:00100000:1.0:1788612544.968927:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328960 00000100:00100000:1.0:1788612544.968993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612544.969004:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:10485:x1875495914328960:12345-192.168.203.30@tcp:36:chmod.0 00010000:00010000:1.0:1788612544.969055:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612544.969084:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc814f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d9 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.969102:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a600) 00010000:00010000:1.0:1788612544.969111:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612544.969135:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.969148:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.969157:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612544.969382:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f725edf7 reply state 0000000058528ffd transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.969395:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612544.969401:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:1.0:1788612544.969404:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788612544.969407:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788612544.969414:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788612544.969536:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:10485:x1875495914328960:12345-192.168.203.30@tcp:36:chmod.0 Request processed in 533us (718us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788612544.969543:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1788612545.002799:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.002931:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329088 00000100:00100000:1.0:1788612545.002942:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329088 00000100:00100000:1.0:1788612545.003011:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1788612545.003022:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:10486:x1875495914329088:12345-192.168.203.30@tcp:101:chown.0 00010000:00010000:1.0:1788612545.003045:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612545.003066:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc815d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220e0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.003127:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8164 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.003141:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.003152:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612545.003216:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612545.003219:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612545.003253:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.003278:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc815d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220e0 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.003295:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8164 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220e0 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.003304:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:1.0:1788612545.003307:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612545.003311:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b000, rc 0) 00000100:00100000:1.0:1788612545.003370:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:10486:x1875495914329088:12345-192.168.203.30@tcp:101:chown.0 Request processed in 351us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.003377:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1788612545.006843:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612545.008045:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329216 00000100:00100000:3.0:1788612545.008058:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329216 00000100:00100000:2.0:1788612545.008368:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612545.008382:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:10486:x1875495914329216:12345-192.168.203.30@tcp:101:chown.0 00010000:00010000:2.0:1788612545.008402:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612545.008424:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bc816b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220e7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008505:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008534:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008556:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008592:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008602:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008610:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008679:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8180 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008687:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008693:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612545.008731:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612545.008735:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612545.008756:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008777:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008793:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008800:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008805:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.008810:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008816:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008829:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:2.0:1788612545.008832:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.008837:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008843:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc8172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008856:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008862:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008868:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008873:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.008881:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008888:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008896:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9611c65f7800) 00010000:00010000:2.0:1788612545.008898:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.008901:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008907:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8179 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008934:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bc816b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220e7 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008949:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8180 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220e7 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.008956:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:2.0:1788612545.008959:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612545.008961:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36a00, rc 0) 00000100:00100000:2.0:1788612545.009029:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:10486:x1875495914329216:12345-192.168.203.30@tcp:101:chown.0 Request processed in 651us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612545.009036:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1788612545.015032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612545.015239:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329344 00000100:00100000:3.0:1788612545.015249:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329344 00000100:00100000:3.0:1788612545.015306:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612545.015317:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:10486:x1875495914329344:12345-192.168.203.30@tcp:900:chown.0 00000100:00100000:3.0:1788612545.015392:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:10486:x1875495914329344:12345-192.168.203.30@tcp:900:chown.0 Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612545.015400:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612545.019016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612545.019265:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329600 00000100:00100000:0.0:1788612545.019275:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329600 00000100:00100000:0.0:1788612545.019341:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1788612545.019353:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:10486:x1875495914329600:12345-192.168.203.30@tcp:36:chown.0 00010000:00010000:0.0:1788612545.019405:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612545.019432:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8180 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220e7 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.019451:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:0.0:1788612545.019455:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612545.019525:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.019538:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.019548:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612545.022920:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1788612545.023028:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000469b572 reply state 00000000244b511a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.023050:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.023059:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:1.0:1788612545.023062:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788612545.023068:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788612545.023081:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788612545.023190:0:8253:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788612545.023362:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:10486:x1875495914329600:12345-192.168.203.30@tcp:36:chown.0 Request processed in 4008us (4351us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788612545.023386:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00010000:00010000:2.0:1788612545.026344:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026361:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026383:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026388:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.026392:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026401:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026418:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9611c65f7800) 00010000:00010000:2.0:1788612545.026421:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.026425:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026431:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc813a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026453:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026459:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026466:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026471:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.026487:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026503:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026511:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:2.0:1788612545.026514:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.026517:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026522:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc8141 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026537:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026544:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026549:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026554:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ae00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.026557:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026563:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026570:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:2.0:1788612545.026573:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788612545.026586:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.026602:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8156 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037263:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037280:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037287:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037293:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612545.037298:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037306:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037329:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:3.0:1788612545.037332:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788612545.037350:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.037357:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8187 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612545.055592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.055722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329728 00000100:00100000:2.0:1788612545.055745:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329728 00000100:00100000:2.0:1788612545.055817:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1788612545.055826:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:10487:x1875495914329728:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:2.0:1788612545.055852:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612545.055872:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc818e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220ee expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612545.056910:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 989us 00010000:00010000:2.0:1788612545.095062:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.095084:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.095096:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.095111:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.095118:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.095124:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.098599:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc81a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.098632:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.098644:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612545.098683:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612545.098702:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612545.099234:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099252:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099259:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099266:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099272:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.099276:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099285:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099299:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:2.0:1788612545.099302:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.099307:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099326:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099343:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099349:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099355:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099359:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.099362:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099368:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099376:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9612f7b2e400) 00010000:00010000:2.0:1788612545.099378:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.099382:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099387:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc819c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099598:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc818e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220ee expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099615:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc81a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220ee expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.099629:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:2.0:1788612545.099632:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788612545.099635:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37e00, rc 0) 00000100:00100000:2.0:1788612545.100345:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:10487:x1875495914329728:12345-192.168.203.30@tcp:101:touch.500 Request processed in 44515us (44769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612545.100355:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1788612545.108983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.109506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329984 00000100:00100000:2.0:1788612545.109516:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329984 00000100:00100000:2.0:1788612545.109584:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1788612545.109595:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:10487:x1875495914329984:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:2.0:1788612545.109620:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612545.109640:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220f5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.109764:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.109787:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.109798:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.109812:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.109820:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.109846:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612545.110226:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788612545.110361:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc81bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110370:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc81bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110377:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc81bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110406:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110413:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110821:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110827:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.110832:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110840:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110852:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:2.0:1788612545.110855:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.110868:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110875:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612545.110889:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb9368f0 reply state 000000002a00f8a9 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110900:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.110974:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9612f7b2e100) 00010000:00010000:2.0:1788612545.110977:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612545.110980:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788612545.111016:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220f5 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.111032:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc81bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220f5 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.111039:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:2.0:1788612545.111041:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612545.111044:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36c00, rc 0) 00000100:00100000:2.0:1788612545.111176:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:10487:x1875495914329984:12345-192.168.203.30@tcp:101:touch.500 Request processed in 1582us (2200us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788612545.111184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1788612545.130824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.130883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.130923:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.131006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.131035:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330240 00000100:00100000:1.0:1788612545.131044:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330240 00000100:00100000:1.0:1788612545.131097:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330496 00000100:00100000:1.0:1788612545.131100:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330496 00000100:00100000:1.0:1788612545.131120:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330368 00000100:00100000:1.0:1788612545.131123:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330368 00000100:00100000:1.0:1788612545.131141:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:1.0:1788612545.131151:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914330240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612545.131236:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914330240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 86us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.131243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:1.0:1788612545.131261:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:1.0:1788612545.131268:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914330496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612545.131293:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914330496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.131299:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:1.0:1788612545.131310:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:1.0:1788612545.131317:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914330368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612545.131357:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914330368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.131364:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00080000:0.0:1788612545.131877:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612545.131883:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612545.132113:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330112 00000100:00100000:3.0:1788612545.132119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330112 00000100:00100000:3.0:1788612545.132170:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:3.0:1788612545.132179:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914330112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612545.132227:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914330112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 49us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612545.132234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:1.0:1788612545.137063:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.137214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330752 00000100:00100000:2.0:1788612545.137224:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330752 00000100:00100000:2.0:1788612545.137284:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1788612545.137294:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:10487:x1875495914330752:12345-192.168.203.30@tcp:36:touch.500 00010000:00010000:2.0:1788612545.137363:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612545.137388:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc81bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220f5 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.137407:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2ea00) 00010000:00010000:2.0:1788612545.137418:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612545.137523:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.137536:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.137884:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612545.138001:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000837e1883 reply state 00000000f6322443 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.138013:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.138020:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:2.0:1788612545.138022:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612545.138025:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612545.138123:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:10487:x1875495914330752:12345-192.168.203.30@tcp:36:touch.500 Request processed in 830us (1069us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788612545.138132:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1788612545.141837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.142031:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330880 00000100:00100000:1.0:1788612545.142041:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330880 00000100:00100000:1.0:1788612545.142098:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:1.0:1788612545.142108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:10487:x1875495914330880:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:1.0:1788612545.142130:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612545.142152:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc81d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d220fc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.142214:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc81d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220fc expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.142229:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc81d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220fc expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.142246:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:1.0:1788612545.142249:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612545.142252:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a000, rc 0) 00000100:00100000:1.0:1788612545.142308:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:10487:x1875495914330880:12345-192.168.203.30@tcp:101:touch.500 Request processed in 201us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.142314:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1788612545.152615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.152860:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331008 00000100:00100000:1.0:1788612545.152869:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331008 00000100:00100000:1.0:1788612545.152917:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612545.152940:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875495914331008:12345-192.168.203.30@tcp:8:touch.500 00010000:00080000:1.0:1788612545.153045:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:1.0:1788612545.153078:0:8440:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc81db 00002000:00100000:1.0:1788612545.153090:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e1800c7e-b9d8-4080-b6d8-c71cdf3d497c/ffff9611c7a6e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612545.153106:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1788612545.153181:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612545.153211:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9611c7a6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612545.153275:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914331008:12345-192.168.203.30@tcp:8:touch.500 Request processed in 335us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.153283:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1788612545.156266:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.157148:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331136 00000100:00100000:1.0:1788612545.157158:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331136 00000100:00100000:1.0:1788612545.157242:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612545.157252:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914331136:12345-192.168.203.30@tcp:2:touch.500 00000100:00080000:0.0:1788612545.157252:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788612545.168285:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788612545.168300:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000100:00100000:1.0:1788612545.168584:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:0:x1875495914331136:12345-192.168.203.30@tcp:2:touch.500 Request processed in 11328us (12320us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788612545.168595:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1788612545.174369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.174795:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331392 00000100:00100000:2.0:1788612545.174808:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331392 00000100:00100000:2.0:1788612545.174874:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788612545.174885:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:10487:x1875495914331392:12345-192.168.203.30@tcp:35:touch.500 00000100:00100000:2.0:1788612545.175257:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:10487:x1875495914331392:12345-192.168.203.30@tcp:35:touch.500 Request processed in 372us (896us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788612545.175265:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788612545.192633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612545.192950:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331520 00000100:00100000:1.0:1788612545.192961:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331520 00000100:00100000:1.0:1788612545.193032:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1788612545.193043:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:10488:x1875495914331520:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1788612545.193065:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612545.193086:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc81e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22103 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.193326:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc81e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.193341:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc81e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.193352:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc81e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612545.193397:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612545.193401:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612545.193437:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc81e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.193464:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc81e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22103 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.193523:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc81e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22103 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612545.193533:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:1.0:1788612545.193537:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612545.193541:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:0.0:1788612545.194434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:10488:x1875495914331520:12345-192.168.203.30@tcp:101:rm.0 Request processed in 1388us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612545.194443:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1788612545.212074:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.212177:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331776 00000100:00100000:2.0:1788612545.212186:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331776 00000100:00100000:2.0:1788612545.212251:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1788612545.212261:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:10488:x1875495914331776:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788612545.212282:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612545.212304:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2210a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612545.212398:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788612545.212584:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2210a expref: 16 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.212599:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:2.0:1788612545.212602:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612545.212608:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc81f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2210a expref: 16 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.212622:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37600, rc 0) 00000100:00100000:2.0:1788612545.212686:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:10488:x1875495914331776:12345-192.168.203.30@tcp:101:rm.0 Request processed in 426us (621us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788612545.212703:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788612545.217436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.217559:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331904 00000100:00100000:2.0:1788612545.217568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331904 00000100:00100000:2.0:1788612545.217628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1788612545.217637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:10488:x1875495914331904:12345-192.168.203.30@tcp:37:rm.0 00000100:00100000:2.0:1788612545.226401:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:10488:x1875495914331904:12345-192.168.203.30@tcp:37:rm.0 Request processed in 8755us (8964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612545.226413:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1788612545.233366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612545.234430:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332160 00000100:00100000:0.0:1788612545.234441:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332160 00000100:00100000:0.0:1788612545.234550:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612545.234561:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:10488:x1875495914332160:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:0.0:1788612545.234794:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:10488:x1875495914332160:12345-192.168.203.30@tcp:35:rm.0 Request processed in 234us (1435us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788612545.234803:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1788612545.237437:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612545.237521:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332416 00000100:00100000:0.0:1788612545.237530:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332416 00000100:00100000:0.0:1788612545.237743:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:0.0:1788612545.237755:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:10488:x1875495914332416:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1788612545.237806:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612545.237826:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc81fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22111 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.237920:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc8205 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.237934:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc8205 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.237944:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc8205 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612545.237954:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788612545.238091:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc81fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22111 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.238108:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc8205 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22111 expref: 18 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.238117:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:0.0:1788612545.238119:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612545.238122:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924600, rc 0) 00000100:00100000:0.0:1788612545.238191:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914332416:12345-192.168.203.30@tcp:101:rm.0 Request processed in 439us (760us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788612545.238198:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1788612545.240508:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612545.241684:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332544 00000100:00100000:0.0:1788612545.241697:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332544 00000100:00100000:0.0:1788612545.241787:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1788612545.241811:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914332544:12345-192.168.203.30@tcp:41:rm.0 00000004:00000024:0.0:1788612545.241864:0:8253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788612545.241934:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914332544:12345-192.168.203.30@tcp:41:rm.0 Request processed in 124us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612545.241941:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1788612545.246394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612545.246792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332672 00000100:00100000:3.0:1788612545.246802:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332672 00000100:00100000:0.0:1788612545.246934:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1788612545.246945:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914332672:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1788612545.247034:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612545.247059:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925600/0x1f8616bf0bc8213 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22118 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247123:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247139:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247151:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247174:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247182:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247189:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247309:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247462:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247470:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612545.247705:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788612545.247710:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612545.247727:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247740:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247748:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247755:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247761:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247873:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612545.247878:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247887:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247902:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:0.0:1788612545.247905:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612545.247920:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247927:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc821a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247945:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247952:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247957:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.247961:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612545.248018:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.248026:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.248034:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9612f7b2e100) 00010000:00010000:0.0:1788612545.248036:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612545.248040:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.248045:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8221 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.248079:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925600/0x1f8616bf0bc8213 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22118 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.248105:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22118 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.248112:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:0.0:1788612545.248114:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612545.248116:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924e00, rc 0) 00000100:00100000:0.0:1788612545.248397:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:10488:x1875495914332672:12345-192.168.203.30@tcp:101:rm.0 Request processed in 1451us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612545.248406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1788612545.252569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612545.253303:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332928 00000100:00100000:2.0:1788612545.253314:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332928 00000100:00100000:2.0:1788612545.253375:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1788612545.253386:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:10488:x1875495914332928:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1788612545.253438:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788612545.253462:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8228 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22118 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253504:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc81d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220fc expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253517:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:2.0:1788612545.253528:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc81e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22103 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253535:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:2.0:1788612545.253538:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612545.253574:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253588:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253599:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253609:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253616:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253622:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253705:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253714:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.253720:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612545.257009:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788612545.257031:0:8253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359640554364ns, next at 360640550226ns, rc = 0 00010000:00010000:2.0:1788612545.257108:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.257125:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.257151:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258065:0:8253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258079:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258086:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258236:0:8253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612545.258263:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258270:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258276:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258282:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.258286:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258294:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258308:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:2.0:1788612545.258311:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788612545.258330:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258336:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc823d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258360:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258367:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258372:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258378:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612545.258381:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258387:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258396:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:2.0:1788612545.258398:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612545.258401:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258409:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc822f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612545.258419:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006272f3ed reply state 0000000072366e79 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258442:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612545.258449:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9612f7b2e100) 00010000:00010000:2.0:1788612545.258451:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612545.258454:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612545.258570:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914332928:12345-192.168.203.30@tcp:36:rm.0 Request processed in 5181us (6005us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788612545.258580:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00010000:00010000:3.0:1788612545.259141:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612545.259150:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.259350:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612545.259355:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.259362:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.259374:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:3.0:1788612545.259376:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612545.259389:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.259395:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8244 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612545.259407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612545.259409:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612545.259411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612545.264642:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612545.264774:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333184 00000100:00100000:3.0:1788612545.264785:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333184 00000100:00100000:3.0:1788612545.264843:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612545.264854:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914333184:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:3.0:1788612545.265081:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:10488:x1875495914333184:12345-192.168.203.30@tcp:35:rm.0 Request processed in 228us (449us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788612545.265089:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1788612545.267742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612545.267820:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333440 00000100:00100000:0.0:1788612545.267834:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333440 00000100:00100000:0.0:1788612545.267905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1788612545.267917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:10488:x1875495914333440:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1788612545.267977:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788612545.268006:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc8205 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22111 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268029:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc81a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220ee expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268042:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9612f7b2e900) 00010000:00010000:0.0:1788612545.268059:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8164 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220e0 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268088:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8a100) 00010000:00010000:0.0:1788612545.268095:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612545.268118:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268130:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268320:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268338:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268346:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268352:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268433:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268441:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.268448:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612545.268999:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788612545.269015:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269030:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269036:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269042:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612545.269045:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269053:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269063:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9611c65f7000) 00010000:00010000:0.0:1788612545.269066:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788612545.269070:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269077:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8259 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269096:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269102:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269108:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269113:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612545.269121:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269128:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269135:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7f00) 00010000:00010000:0.0:1788612545.269137:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612545.269140:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269922:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc824b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612545.269941:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4040db3 reply state 00000000e33df3a3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269955:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612545.269962:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9611c65f7d00) 00010000:00010000:0.0:1788612545.269965:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612545.269969:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612545.270130:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:10488:x1875495914333440:12345-192.168.203.30@tcp:36:rm.0 Request processed in 2212us (2395us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788612545.270148:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00010000:00010000:0.0:1788612545.904511:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612546.031935:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932239872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612546.032016:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612546.032445:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612546.032454:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932240000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612546.032504:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612546.032583:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932239872 00000100:00100000:3.0:1788612546.032590:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932239872 00000100:00100000:3.0:1788612546.032648:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240000 00000100:00100000:3.0:1788612546.032652:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240000 00000100:00100000:3.0:1788612546.032673:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788612546.032681:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932239872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612546.032707:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612546.032748:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932239872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612546.032755:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788612546.032782:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788612546.032803:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932240000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612546.032813:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612546.032838:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932240000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612546.032843:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788612546.032906:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612546.032934:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bc000 x1875495932240000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612546.032952:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932240000:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788612546.032964:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe943100 x1875495932239872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612546.032974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932239872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612546.033555:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932240256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033604:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.033635:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932240768:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033668:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.033684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932241280:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033703:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.033720:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788612546.033726:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932240128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033772:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.033793:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932240640:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033815:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.033834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932241152:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033855:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.033882:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240640 00000100:00100000:0.0:1788612546.033887:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240640 00000100:00100000:0.0:1788612546.033924:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788612546.033931:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.033972:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932240640:12345-0@lo:400:kworker.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.033979:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788612546.034000:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241152 00000100:00100000:0.0:1788612546.034003:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241152 00000100:00100000:0.0:1788612546.034032:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612546.034038:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932241152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034069:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932241152:12345-0@lo:400:kworker.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034075:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612546.034096:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932240512:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034130:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.034148:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932241024:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034167:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.034184:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788612546.034190:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932240384:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034210:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.034225:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932240896:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034245:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.034261:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932241408:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034281:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612546.034300:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241024 00000100:00100000:0.0:1788612546.034304:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241024 00000100:00100000:0.0:1788612546.034326:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612546.034332:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932241024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034362:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932241024:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034367:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788612546.034380:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612546.034387:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240384 00000100:00100000:0.0:1788612546.034389:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240384 00000100:00100000:0.0:1788612546.034404:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788612546.034409:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932240384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034433:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932240384:12345-0@lo:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034438:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788612546.034470:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932240384:0@lo:400:kworker.0 00010000:00080000:0.0:1788612546.034510:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880e00 x1875495932241024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612546.034518:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932241024:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034541:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932240640:0@lo:400:kworker.0 00010000:00080000:0.0:1788612546.034549:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7882a00 x1875495932241152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612546.034556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932241152:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034572:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240256 00000100:00100000:0.0:1788612546.034575:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240256 00000100:00100000:0.0:1788612546.034591:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240768 00000100:00100000:0.0:1788612546.034592:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240768 00000100:00100000:0.0:1788612546.034606:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241280 00000100:00100000:0.0:1788612546.034608:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241280 00000100:00100000:0.0:1788612546.034618:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240512 00000100:00100000:0.0:1788612546.034620:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240512 00000100:00100000:0.0:1788612546.034627:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240896 00000100:00100000:0.0:1788612546.034629:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240896 00000100:00100000:0.0:1788612546.034638:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241408 00000100:00100000:0.0:1788612546.034640:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241408 00000100:00100000:0.0:1788612546.034651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788612546.034656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932240256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034691:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932240256:12345-0@lo:400:kworker.0 Request processed in 35us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788612546.034709:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788612546.034714:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932240768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034751:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932240768:12345-0@lo:400:kworker.0 Request processed in 36us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034756:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788612546.034784:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788612546.034790:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932241280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034815:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932241280:12345-0@lo:400:kworker.0 Request processed in 25us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034820:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788612546.034832:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788612546.034838:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034864:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932240512:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034869:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788612546.034879:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788612546.034883:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932240896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034906:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932240896:12345-0@lo:400:kworker.0 Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034911:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788612546.034919:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788612546.034924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932241408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.034945:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932241408:12345-0@lo:400:kworker.0 Request processed in 21us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.034950:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1788612546.034962:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612546.034965:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788612546.034986:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7882300 x1875495932240896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612546.034995:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932240896:0@lo:400:kworker.0 00010000:00080000:0.0:1788612546.035003:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7883100 x1875495932241408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612546.035010:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932241408:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.035019:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932240512:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.035042:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932240256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.035050:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932240768:0@lo:400:kworker.0 00000100:00100000:0.0:1788612546.035059:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932241280:0@lo:400:kworker.0 00000100:00100000:1.0:1788612546.035362:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932240128 00000100:00100000:1.0:1788612546.035368:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932240128 00000100:00100000:1.0:1788612546.035407:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788612546.035414:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932240128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612546.035460:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932240128:12345-0@lo:400:kworker.0 Request processed in 46us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612546.035466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788612546.035605:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932240128:0@lo:400:kworker.0 00000004:00080000:1.0:1788612546.543596:0:8540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360927117134ns, next at 361927113844ns, rc = 0 00000100:00100000:2.0:1788612546.543623:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932241664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612546.543635:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612546.543650:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932241536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612546.543713:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612546.543767:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612546.543797:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241664 00000100:00100000:2.0:1788612546.543805:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241664 00000100:00100000:1.0:1788612546.543807:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241536 00000100:00100000:1.0:1788612546.543813:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241536 00000100:00100000:1.0:1788612546.543850:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788612546.543860:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932241536:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612546.543869:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788612546.543879:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932241664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612546.543882:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788612546.543900:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612546.543931:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932241664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612546.543937:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788612546.543987:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe943100 x1875495932241664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612546.544006:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932241664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612546.544075:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932241792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612546.544110:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612546.544136:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241792 00000100:00100000:2.0:1788612546.544141:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241792 00000100:00100000:2.0:1788612546.544192:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788612546.544201:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932241792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612546.544226:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612546.544269:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932241792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612546.544276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788612546.544281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932241792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612546.544566:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932241536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 706us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612546.544574:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1788612546.544632:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c1324a80 x1875495932241536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612546.544646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932241536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788612546.941704:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612547.952060:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612548.976716:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612549.617399:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932241920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612549.617469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612549.617551:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932241920 00000100:00100000:2.0:1788612549.617558:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932241920 00000100:00100000:2.0:1788612549.617600:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788612549.617608:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932241920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612549.617639:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612549.617685:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932241920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612549.617691:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788612549.617766:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932241920:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788612549.719860:0:13688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788612549.999814:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612550.232768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612550.232845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612550.232883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612550.232934:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612550.232974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612550.233004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612550.233031:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333952 00000100:00100000:0.0:1788612550.233040:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333952 00000100:00100000:0.0:1788612550.233101:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:0.0:1788612550.233112:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914333952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612550.233178:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914333952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.233185:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00080000:0.0:1788612550.233206:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612550.233293:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333568 00000100:00100000:1.0:1788612550.233298:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333568 00000100:00100000:1.0:1788612550.233347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 337 00000100:00100000:1.0:1788612550.233355:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914333568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612550.233385:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914333568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612550.233405:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 337 00000100:00100000:3.0:1788612550.233836:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333824 00000100:00100000:3.0:1788612550.233842:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333824 00000100:00100000:3.0:1788612550.233889:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334080 00000100:00100000:3.0:1788612550.233892:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334080 00000100:00100000:3.0:1788612550.233906:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333696 00000100:00100000:3.0:1788612550.233908:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333696 00000100:00100000:3.0:1788612550.233918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334208 00000100:00100000:3.0:1788612550.233920:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334208 00000100:00100000:3.0:1788612550.233933:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:3.0:1788612550.233940:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914333824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612550.233977:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914333824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.233989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:3.0:1788612550.234001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:3.0:1788612550.234007:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914334080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612550.234028:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914334080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.234144:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:0.0:1788612550.234153:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2397:x1875495914333696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612550.234182:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2397:x1875495914333696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.234187:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:0.0:1788612550.234200:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:0.0:1788612550.234206:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914334208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612550.234223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914334208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 18us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.234228:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:3.0:1788612550.234282:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00080000:1.0:1788612550.234461:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612550.234465:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788612550.644105:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788612550.644266:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788612550.644278:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788612550.644307:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644319:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644326:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644333:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612550.644338:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644346:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644364:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9612f7b2e100) 00010000:00010000:1.0:1788612550.644366:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612550.644371:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644377:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc81b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644392:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644403:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644408:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644413:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612550.644416:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644421:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644427:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9612f7b2e400) 00010000:00010000:1.0:1788612550.644429:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612550.644431:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644437:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc81cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644454:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644459:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644464:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644469:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612550.644502:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644509:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644516:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff9612f7b2e100) 00010000:00010000:1.0:1788612550.644519:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612550.644522:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.644527:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37000/0x1f8616bf0bc8236 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.644800:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612550.644849:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932242048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788612550.644912:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612550.645227:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932242048 00000100:00100000:0.0:1788612550.645235:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932242048 00000100:00100000:0.0:1788612550.645298:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612550.645308:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932242048:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788612550.645433:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788612550.645460:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788612550.646242:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c0fc1, atime: 0x6a9c0fc1, ctime: 0x6a9c0fc1, blocks: 0x0 00010000:00010000:0.0:1788612550.646252:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646267:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788612550.646271:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612550.646278:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646294:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646304:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646311:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646330:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788612550.646583:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932242048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1275us (1669us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788612550.646591:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788612550.646619:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612550.646625:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646643:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612550.646648:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646657:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646672:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646680:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000078d9dd9/0x1f8616bf0bc8260 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.646696:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612550.646698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612550.646700:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612550.648525:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.648549:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.648556:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.648562:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612550.648567:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.648574:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.648589:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9611c65f7d00) 00010000:00010000:1.0:1788612550.648592:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612550.648604:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612550.648611:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925a00/0x1f8616bf0bc8252 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612550.649089:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9612fe941500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788612550.649101:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932242048:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1788612550.707937:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddb226a90 20000000:00000080:2.0:1788612550.707954:0:13736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9611c797d800 uarg=0000000000000000 20000000:01000000:2.0:1788612550.707995:0:13736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788612550.708000:0:13736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788612550.708005:0:13736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788612550.708403:0:13737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788612550.708670:0:13736:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788612550.714170:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788612550.714209:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788612550.714225:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788612550.714242:0:13736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788612550.714260:0:13736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714279:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714287:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714293:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714299:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714323:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714331:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714338:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714379:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.714393:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 12 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.714408:0:13736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242176:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612550.717293:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.717312:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.717326:0:13736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242304:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612550.717395:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.717404:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.717433:0:13736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242432:0@lo:104: 00000100:00100000:2.0:1788612550.717508:0:13736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612550.717590:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788612550.717604:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932242432 00000100:00100000:0.0:1788612550.717611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932242432 00000100:00100000:0.0:1788612550.717662:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612550.717671:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13736:x1875495932242432:12345-0@lo:104: 00010000:00010000:0.0:1788612550.717684:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.717759:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612550.717766:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13736:x1875495932242432:12345-0@lo:104: Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.717779:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788612550.717824:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612550.717831:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.717838:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612550.717842:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.717851:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612550.717857:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612550.717862:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788612550.717896:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.717902:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612550.717919:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.717927:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe925e00/0x1f8616bf0bc8117 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc811e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.717938:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612550.717940:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612550.717941:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612550.717947:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612550.717962:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932242560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612550.717988:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612550.718089:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932242560 00000100:00100000:3.0:1788612550.718094:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932242560 00010000:00010000:3.0:1788612550.718115:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 24 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612550.718137:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612550.718143:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932242560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612550.718154:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612550.718158:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 24 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.718167:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 24 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.718182:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612550.718210:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932242560:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.718216:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1788612550.719441:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.719455:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.719467:0:13736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242688:0@lo:104: 00000100:00100000:2.0:1788612550.719648:0:13736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612550.719678:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.719686:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 23 pid: 6518 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.719694:0:13736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242816:0@lo:104: 00000100:00100000:2.0:1788612550.719712:0:13736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612550.719771:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.719779:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.719787:0:13736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242944:0@lo:104: 00000100:00100000:2.0:1788612550.719809:0:13736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612550.719819:0:13736:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78913c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788612550.719841:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc811e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc8117 expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.719862:0:13736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242432:0@lo:104: 00000100:00100000:3.0:1788612550.719913:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932242688 00000100:00100000:3.0:1788612550.719919:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932242688 00000100:00100000:3.0:1788612550.719952:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932242816 00000100:00100000:3.0:1788612550.719955:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932242816 00000100:00100000:3.0:1788612550.719966:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932242944 00000100:00100000:3.0:1788612550.719968:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932242944 00000100:00100000:3.0:1788612550.719980:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612550.719987:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:13736:x1875495932242688:12345-0@lo:104: 00010000:00010000:3.0:1788612550.719999:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720056:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612550.720069:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+5:13736:x1875495932242688:12345-0@lo:104: Request processed in 82us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.720076:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612550.720091:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612550.720098:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:13736:x1875495932242816:12345-0@lo:104: 00010000:00010000:3.0:1788612550.720106:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720147:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788612550.720153:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+4:13736:x1875495932242816:12345-0@lo:104: Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.720159:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612550.720171:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788612550.720177:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13736:x1875495932242944:12345-0@lo:104: 00010000:00010000:3.0:1788612550.720185:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720209:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788612550.720214:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+3:13736:x1875495932242944:12345-0@lo:104: Request processed in 38us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.720219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788612550.720235:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788612550.720241:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720248:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612550.720251:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720270:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612550.720277:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612550.720283:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612550.720310:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720318:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612550.720333:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720340:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c799b600/0x1f8616bf0bc8109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8110 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720351:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612550.720354:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720359:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612550.720362:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720368:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612550.720374:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612550.720384:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612550.720398:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720403:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612550.720419:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720426:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc80fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc8102 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720435:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612550.720437:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720443:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3400 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612550.720445:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720452:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612550.720458:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612550.720463:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612550.720511:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720517:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612550.720530:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.720984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3400/0x1f8616bf0bc80ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc80f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.721003:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612550.721005:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612550.721006:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612550.721015:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612550.721030:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612550.721044:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932243072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612550.721084:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612550.721117:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932243200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612550.721208:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612550.721228:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612550.721234:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932243328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612550.721254:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612550.721284:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243072 00000100:00100000:3.0:1788612550.721289:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243072 00010000:00010000:3.0:1788612550.721311:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 23 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612550.721332:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243200 00000100:00100000:3.0:1788612550.721335:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243200 00010000:00010000:3.0:1788612550.721345:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 24 pid: 6518 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612550.721360:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243328 00000100:00100000:3.0:1788612550.721362:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243328 00010000:00010000:3.0:1788612550.721383:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 25 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612550.721397:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612550.721403:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+25:3648:x1875495932243072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612550.721414:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612550.721420:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 25 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.721429:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 25 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.721445:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612550.721663:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3600/0x1f8616bf0bc8110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc8109 expref: 25 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.721675:0:13736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242688:0@lo:104: 00000100:00100000:2.0:1788612550.721685:0:13736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242816:0@lo:104: 00000100:00100000:2.0:1788612550.721692:0:13736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242944:0@lo:104: 00000100:00100000:2.0:1788612550.722880:0:13736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242176:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612550.723035:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932243072:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.723046:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612550.723074:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612550.723083:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932243200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612550.723096:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612550.723104:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 23 pid: 6518 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.723114:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 23 pid: 6518 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.723140:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030200/0x1f8616bf0bc8102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc80fb expref: 23 pid: 6518 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.723154:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612550.723202:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:3650:x1875495932243200:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.723221:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612550.723234:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612550.723241:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3650:x1875495932243328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612550.723249:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612550.723254:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 21 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.723261:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 21 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.723271:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc80f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc80ed expref: 21 pid: 6517 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.723281:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612550.723303:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3650:x1875495932243328:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.723309:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612550.723347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932243072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612550.723375:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932243328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612550.723382:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932243200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612550.724308:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932242560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612550.724740:0:13736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875495932242304:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612550.724775:0:13736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612550.726023:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612550.726064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612550.726127:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334336 00000100:00100000:2.0:1788612550.726136:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334336 00010000:00010000:2.0:1788612550.726174:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 13 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.726211:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334464 00000100:00100000:2.0:1788612550.726214:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334464 00010000:00010000:2.0:1788612550.726227:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612550.726254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1788612550.726263:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+14:2394:x1875495914334336:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612550.726277:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612550.726283:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726293:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726330:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc812c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220d2 expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726347:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612550.726400:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914334336:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 137us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612550.726408:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1788612550.726426:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:2.0:1788612550.726433:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:2394:x1875495914334464:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612550.726441:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612550.726446:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726454:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726464:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc8125 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d220cb expref: 12 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726514:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726523:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726654:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726673:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726680:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726687:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726693:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612550.726698:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726706:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726718:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612550.726795:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612550.726817:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:2394:x1875495914334464:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 385us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612550.726824:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00010000:00010000:3.0:1788612550.727553:0:13736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.727578:0:13736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612550.727585:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8267 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612551.023800:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612551.152050:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932244096:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932244608:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152258:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152285:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788612551.152291:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932243456:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152310:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152325:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152376:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932244480:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152396:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932243712:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932244224:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152686:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152706:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932244736:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152739:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152762:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788612551.152782:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932243840:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152824:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932244352:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152843:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.152872:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243584 00000100:00100000:0.0:1788612551.152879:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243584 00000100:00100000:0.0:1788612551.152916:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243840 00000100:00100000:0.0:1788612551.152919:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243840 00000100:00100000:0.0:1788612551.152936:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788612551.152945:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.152999:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932243584:12345-0@lo:400:kworker.0 Request processed in 54us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.153006:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788612551.153022:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788612551.153029:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932243840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.153063:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932243840:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.153068:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788612551.153086:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244096 00000100:00100000:0.0:1788612551.153089:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244096 00000100:00100000:0.0:1788612551.153115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243456 00000100:00100000:0.0:1788612551.153118:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243456 00000100:00100000:0.0:1788612551.153128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243968 00000100:00100000:0.0:1788612551.153131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243968 00000100:00100000:0.0:1788612551.153142:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244480 00000100:00100000:0.0:1788612551.153144:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244480 00000100:00100000:0.0:1788612551.153155:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932243712 00000100:00100000:0.0:1788612551.153157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932243712 00000100:00100000:0.0:1788612551.153167:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244352 00000100:00100000:0.0:1788612551.153176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244352 00000100:00100000:0.0:1788612551.153193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788612551.153199:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932244096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788612551.153652:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612551.153657:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612551.153959:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932244096:12345-0@lo:400:kworker.0 Request processed in 759us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.153968:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788612551.153986:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788612551.153992:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932243456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.154024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932243456:12345-0@lo:400:kworker.0 Request processed in 33us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.154030:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788612551.154040:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788612551.154046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.154072:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932243968:12345-0@lo:400:kworker.0 Request processed in 26us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.154083:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788612551.154094:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788612551.154100:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932244480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.154126:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932244480:12345-0@lo:400:kworker.0 Request processed in 26us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.154132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788612551.154143:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788612551.154149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932243712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.154175:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932243712:12345-0@lo:400:kworker.0 Request processed in 27us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.154192:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788612551.154204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788612551.154210:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932244352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.154236:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932244352:12345-0@lo:400:kworker.0 Request processed in 26us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.154242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788612551.154261:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244608 00000100:00100000:0.0:1788612551.154266:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244608 00000100:00100000:3.0:1788612551.154363:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244224 00000100:00100000:3.0:1788612551.154368:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244224 00000100:00100000:0.0:1788612551.155011:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244736 00000100:00100000:0.0:1788612551.155018:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244736 00000100:00100000:2.0:1788612551.156744:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932244992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612551.156819:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612551.156886:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244992 00000100:00100000:2.0:1788612551.156893:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244992 00000100:00100000:2.0:1788612551.156936:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788612551.156945:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932244992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612551.156985:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612551.157028:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932244992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612551.157034:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1788612551.157073:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880a80 x1875495932244992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612551.157090:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932244992:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788612551.159282:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612551.159290:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612551.159436:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612551.159450:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932244608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159558:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932244608:12345-0@lo:400:kworker.0 Request processed in 113us (7298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612551.159566:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612551.159583:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788612551.159590:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159624:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932244224:12345-0@lo:400:kworker.0 Request processed in 36us (6938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612551.159630:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788612551.159696:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932244864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612551.159742:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612551.159809:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932243840:0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159822:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932244352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159833:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159862:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932244224:0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159902:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932243456:0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932243968:0@lo:400:kworker.0 00010000:00080000:3.0:1788612551.159926:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79bc000 x1875495932244480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612551.159936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932244480:0@lo:400:kworker.0 00000100:00100000:3.0:1788612551.159948:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932243584:0@lo:400:kworker.0 00010000:00080000:3.0:1788612551.159957:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864e00 x1875495932244096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612551.159965:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932244096:0@lo:400:kworker.0 00010000:00080000:3.0:1788612551.159974:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7adf100 x1875495932244608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612551.159982:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932244608:0@lo:400:kworker.0 00000100:00100000:2.0:1788612551.165697:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932244864 00000100:00100000:2.0:1788612551.165711:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932244864 00000100:00100000:2.0:1788612551.165785:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788612551.165795:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932244864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612551.165820:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612551.165917:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932244864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612551.165924:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788612551.165971:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78fdf80 x1875495932244864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612551.165991:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932244864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612551.169205:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788612551.169219:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932244736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.169306:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932244736:12345-0@lo:400:kworker.0 Request processed in 90us (16566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.169313:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788612551.169586:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7addc00 x1875495932244736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612551.169601:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932244736:0@lo:400:kworker.0 00000100:00100000:0.0:1788612551.664013:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932245120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612551.664089:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.664164:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932245248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612551.664195:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612551.664241:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245120 00000100:00100000:0.0:1788612551.664248:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245120 00000100:00100000:0.0:1788612551.664299:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612551.664317:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932245120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612551.664345:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612551.664389:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932245120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.664396:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612551.664418:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245248 00000100:00100000:0.0:1788612551.664422:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245248 00000100:00100000:0.0:1788612551.664447:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788612551.664454:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932245248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612551.664492:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612551.664527:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932245248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612551.664533:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788612551.664578:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932245248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612551.664610:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932245120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612551.673930:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932245376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612551.674013:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612551.674244:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245376 00000100:00100000:3.0:1788612551.674253:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245376 00000100:00100000:3.0:1788612551.674298:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788612551.674308:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932245376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612551.674330:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612551.674390:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932245376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612551.674397:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788612551.674443:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932245376:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1788612551.810086:0:13785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe24456d20 20000000:00000080:3.0:1788612551.810103:0:13785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9612ff0c6000 uarg=0000000000000000 20000000:01000000:3.0:1788612551.810143:0:13785:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788612551.810150:0:13785:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788612551.810155:0:13785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788612551.810882:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788612551.811107:0:13785:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788612551.811175:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788612551.811203:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788612551.811217:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788612551.811229:0:13785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788612551.811248:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811263:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811274:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811280:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811287:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811294:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811300:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612551.811304:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811400:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811412:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811419:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612551.811425:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc826e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.047804:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612552.225665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612552.225905:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334592 00000100:00100000:3.0:1788612552.225915:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334592 00000100:00100000:3.0:1788612552.225975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 338 00000100:00100000:3.0:1788612552.225985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:6166:x1875495914334592:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612552.226001:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612552.226020:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc8275 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2211f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.226049:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc8275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2211f expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.226060:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc8275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2211f expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.226068:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2c00, rc 0) 00000100:00100000:3.0:1788612552.226148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914334592:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 164us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.226169:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 338 00000100:00100000:2.0:1788612552.235002:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612552.237037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334720 00000100:00100000:0.0:1788612552.237051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334720 00000100:00100000:0.0:1788612552.237125:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00100000:0.0:1788612552.237135:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914334720:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.237302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914334720:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 167us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.237310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00100000:0.0:1788612552.244263:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612552.244426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334848 00000100:00100000:1.0:1788612552.244436:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334848 00000100:00100000:1.0:1788612552.244536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 340 00000100:00100000:1.0:1788612552.244547:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914334848:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.244694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914334848:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 149us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.244702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 340 00000100:00100000:2.0:1788612552.260892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612552.261397:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334976 00000100:00100000:0.0:1788612552.261420:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334976 00000100:00100000:0.0:1788612552.261506:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 341 00000100:00100000:0.0:1788612552.261518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:10773:x1875495914334976:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612552.261675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:10773:x1875495914334976:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 159us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.261684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 341 00000100:00100000:0.0:1788612552.292283:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612552.292401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335104 00000100:00100000:1.0:1788612552.292410:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335104 00000100:00100000:1.0:1788612552.293017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:1.0:1788612552.293031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:10773:x1875495914335104:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612552.293334:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:10773:x1875495914335104:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 306us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.293342:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:1.0:1788612552.300290:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612552.300380:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335232 00000100:00100000:3.0:1788612552.300390:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335232 00000100:00100000:3.0:1788612552.300452:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:3.0:1788612552.300462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:6166:x1875495914335232:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612552.300649:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612552.300667:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc827c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22126 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.300700:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc827c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22126 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.300711:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc827c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22126 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.300728:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3400, rc 0) 00000100:00100000:3.0:1788612552.300940:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914335232:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 478us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.300948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:2.0:1788612552.314074:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612552.314430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335360 00000100:00100000:1.0:1788612552.314440:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335360 00000100:00100000:1.0:1788612552.314560:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:1.0:1788612552.314595:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914335360:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.314765:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914335360:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 171us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.314781:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:0.0:1788612552.317096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612552.321696:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335488 00000100:00100000:2.0:1788612552.321737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335488 00000100:00100000:2.0:1788612552.321859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 345 00000100:00100000:2.0:1788612552.321872:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914335488:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612552.322032:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:6166:x1875495914335488:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 161us (4942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612552.322040:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 345 00000100:00100000:2.0:1788612552.326974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612552.327212:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335616 00000100:00100000:1.0:1788612552.327222:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335616 00000100:00100000:1.0:1788612552.327292:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 346 00000100:00100000:1.0:1788612552.327302:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:10777:x1875495914335616:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612552.327463:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:10777:x1875495914335616:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 162us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.327472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 346 00000100:00100000:3.0:1788612552.337402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612552.337519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335744 00000100:00100000:2.0:1788612552.337530:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335744 00000100:00100000:2.0:1788612552.337592:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 347 00000100:00100000:2.0:1788612552.337602:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:10777:x1875495914335744:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612552.337763:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:10777:x1875495914335744:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 162us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612552.337771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 347 10000000:01000000:3.0:1788612552.368932:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612552.368941:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c67e2000 from 7 10000000:01000000:3.0:1788612552.368945:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612552.368993:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.369004:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.369036:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612552.369062:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932245504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.369141:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.369220:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.370258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245504 00000100:00100000:0.0:1788612552.370269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245504 00000100:00100000:0.0:1788612552.370325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788612552.370336:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:6520:x1875495932245504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612552.370353:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612552.370369:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe925e00/0x1f8616bf0bc828a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8283 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.370398:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe925e00/0x1f8616bf0bc828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8283 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.370410:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe925e00/0x1f8616bf0bc828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8283 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.370419:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe925e00, rc 0) 00000100:00100000:0.0:1788612552.370535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932245504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.370542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788612552.373762:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932245504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612552.373792:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.373804:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612552.374038:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932245632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.374105:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.374206:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612552.375625:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245632 00000100:00100000:1.0:1788612552.375636:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245632 00000100:00100000:1.0:1788612552.375755:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788612552.375765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932245632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.375922:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932245632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.375930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788612552.376015:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932245632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.376059:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932245760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.376112:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.381235:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.385466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245760 00000100:00100000:0.0:1788612552.385502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245760 00000100:00100000:0.0:1788612552.385584:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788612552.385594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932245760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.385742:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932245760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (9630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.385750:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788612552.385896:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932245760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612552.386282:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13798:1875495932245888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612552.386324:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612552.386355:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7891900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.386397:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932245888 00000100:00100000:0.0:1788612552.386401:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932245888 00000100:00100000:0.0:1788612552.386429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788612552.386437:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:13798:x1875495932245888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612552.386674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:13798:x1875495932245888:12345-0@lo:502:llog_process_th.0 Request processed in 234us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.386682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788612552.386766:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13798:1875495932245888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612552.386787:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612552.386796:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.386798:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612552.386807:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c67e2000 00000020:00000080:2.0:1788612552.386809:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612552.386867:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612552.386871:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.386872:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612552.386881:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612552.386884:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.386885:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788612552.386888:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c67e2000 00000020:00000080:2.0:1788612552.386890:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788612552.386924:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13798:1875495932246016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612552.386956:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612552.386984:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7891900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.388576:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246016 00000100:00100000:0.0:1788612552.388588:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246016 00000100:00100000:0.0:1788612552.388637:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788612552.388647:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:13798:x1875495932246016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612552.388777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:13798:x1875495932246016:12345-0@lo:502:llog_process_th.0 Request processed in 130us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.388784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788612552.389638:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13798:1875495932246016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612552.389674:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612552.389682:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.389684:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788612552.389691:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788612552.390763:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788612552.390790:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612552.390801:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.390813:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612552.390835:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612552.390837:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fcfb4000 from 7 10000000:01000000:0.0:1788612552.390840:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612552.390871:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.390879:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.390888:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612552.390908:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.390963:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612552.391002:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612552.391079:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246144 00000100:00100000:2.0:1788612552.391085:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246144 00000100:00100000:2.0:1788612552.391117:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788612552.391125:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:6520:x1875495932246144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612552.391136:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612552.391146:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8298 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc8291 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.391178:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc8291 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.391188:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc8291 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.391196:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37a00, rc 0) 00000100:00100000:2.0:1788612552.391233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932246144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612552.391245:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788612552.391974:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612552.391989:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.392010:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612552.392068:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.392097:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.392161:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612552.397262:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246272 00000100:00100000:2.0:1788612552.397276:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246272 00000100:00100000:2.0:1788612552.398640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788612552.398656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932246272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612552.398837:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932246272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (6738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612552.398844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788612552.402830:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.402895:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.402965:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612552.404872:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c79520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.406546:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246400 00000100:00100000:0.0:1788612552.406559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246400 00000100:00100000:0.0:1788612552.406696:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788612552.406705:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932246400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.406869:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932246400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (3904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.406877:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788612552.406931:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.407319:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13802:1875495932246528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612552.407364:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612552.407389:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246528 00000100:00100000:0.0:1788612552.407398:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246528 00000100:00100000:0.0:1788612552.407417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788612552.407423:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:13802:x1875495932246528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612552.407518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:13802:x1875495932246528:12345-0@lo:502:llog_process_th.0 Request processed in 94us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.407537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788612552.407577:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.407589:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13802:1875495932246528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612552.407611:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612552.407620:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612552.407623:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788612552.407628:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612fcfb4000 00000020:00000080:0.0:1788612552.407630:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612552.407687:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612552.408089:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612552.408092:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788612552.408097:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612552.408101:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612552.408102:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788612552.408106:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612fcfb4000 00000020:00000080:0.0:1788612552.408120:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788612552.408331:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13802:1875495932246656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612552.408380:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612552.408407:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246656 00000100:00100000:0.0:1788612552.408412:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246656 00000100:00100000:0.0:1788612552.408435:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788612552.408441:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:13802:x1875495932246656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612552.408681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:13802:x1875495932246656:12345-0@lo:502:llog_process_th.0 Request processed in 237us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.408694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788612552.408739:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.408754:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13802:1875495932246656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612552.408778:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612552.408783:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612552.408785:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788612552.408788:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788612552.409049:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788612552.409088:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612552.409097:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.410328:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612552.410343:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612552.410346:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fccf8000 from 7 10000000:01000000:0.0:1788612552.410349:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612552.410383:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.410392:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.410402:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612552.410426:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.410496:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612552.410601:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612552.410620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246784 00000100:00100000:0.0:1788612552.410627:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246784 00000100:00100000:0.0:1788612552.410659:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788612552.410666:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:6520:x1875495932246784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612552.410678:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612552.410690:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612fe925a00/0x1f8616bf0bc82a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc829f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.410714:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612fe925a00/0x1f8616bf0bc82a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc829f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.410735:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612fe925a00/0x1f8616bf0bc82a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc829f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.410744:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe925a00, rc 0) 00000100:00100000:0.0:1788612552.410780:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932246784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612552.410787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788612552.410828:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246784:0@lo:101:ll_cfg_requeue.0 00000040:00080000:3.0:1788612552.411437:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612552.411690:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.411704:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612552.411781:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612552.411823:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612552.412939:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612552.413432:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932246912 00000100:00100000:3.0:1788612552.413440:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932246912 00000100:00100000:3.0:1788612552.413497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788612552.413506:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932246912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.413647:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932246912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.413656:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788612552.413701:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932246912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.413752:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.413794:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.413813:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612552.413823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247040 00000100:00100000:3.0:1788612552.413826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247040 00000100:00100000:3.0:1788612552.414045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788612552.414055:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932247040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.414132:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932247040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.414146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788612552.414179:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.414327:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13803:1875495932247168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612552.414357:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.414375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247168 00000100:00100000:3.0:1788612552.414378:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247168 00000100:00100000:3.0:1788612552.414394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788612552.414399:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:13803:x1875495932247168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612552.414454:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:13803:x1875495932247168:12345-0@lo:502:llog_process_th.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.414460:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788612552.414506:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612552.414516:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13803:1875495932247168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612552.414545:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612552.414552:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612552.414554:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612552.414560:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612fccf8000 00000020:00000080:3.0:1788612552.414562:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612552.414614:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612552.415212:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612552.415216:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612552.415221:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612552.415224:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612552.415226:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788612552.415230:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612fccf8000 00000020:00000080:3.0:1788612552.415232:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788612552.415425:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13803:1875495932247296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612552.415510:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.416741:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247296 00000100:00100000:3.0:1788612552.416750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247296 00000100:00100000:3.0:1788612552.416790:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788612552.416798:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:13803:x1875495932247296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612552.417712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:13803:x1875495932247296:12345-0@lo:502:llog_process_th.0 Request processed in 912us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.417733:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788612552.417790:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612552.417813:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13803:1875495932247296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612552.418058:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612552.418067:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612552.418069:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788612552.418074:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788612552.420774:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788612552.420808:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612552.420820:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.420832:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612552.420890:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612552.420893:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c7237000 from 7 10000000:01000000:2.0:1788612552.420896:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612552.420932:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.420942:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.420952:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612552.420975:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612552.421047:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612552.421132:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7891b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612552.425180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247424 00000100:00100000:3.0:1788612552.425194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247424 00000100:00100000:3.0:1788612552.425253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788612552.425264:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:6520:x1875495932247424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612552.425281:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612552.425566:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc82b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc82ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.425597:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc82b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc82ad expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.425608:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc82b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc82ad expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.425640:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3000, rc 0) 00000100:00100000:3.0:1788612552.425729:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932247424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 453us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.425737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788612552.425763:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612552.425782:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.425793:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612552.425874:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612552.425909:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612552.425946:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7891b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612552.425998:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247552 00000100:00100000:1.0:1788612552.426003:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247552 00000100:00100000:1.0:1788612552.426040:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788612552.426055:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932247552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.426181:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932247552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.426188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788612552.426351:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.426380:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612552.426419:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612552.426519:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612552.427625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247680 00000100:00100000:1.0:1788612552.427633:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247680 00000100:00100000:1.0:1788612552.427671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788612552.427677:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932247680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612552.427807:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:6520:x1875495932247680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.427823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788612552.427832:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d04a0405-b620-42fe-8569-8c55f54b9b5e:6520:1875495932247680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612552.428938:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13805:1875495932247808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612552.429005:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612552.429045:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7891000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612552.429101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247808 00000100:00100000:1.0:1788612552.429107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247808 00000100:00100000:1.0:1788612552.429148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788612552.429156:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:13805:x1875495932247808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612552.429252:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:13805:x1875495932247808:12345-0@lo:502:llog_process_th.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.429261:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788612552.429346:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13805:1875495932247808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612552.429370:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612552.429379:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.429381:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612552.429391:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612c7237000 00000020:00000080:2.0:1788612552.429394:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612552.429457:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612552.429461:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.429462:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612552.429465:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612552.429467:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612552.429495:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788612552.429501:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612c7237000 00000020:00000080:2.0:1788612552.429503:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788612552.429538:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13805:1875495932247936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612552.429645:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612552.429661:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7891000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612552.430164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932247936 00000100:00100000:1.0:1788612552.430170:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932247936 00000100:00100000:1.0:1788612552.430854:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788612552.430867:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:13805:x1875495932247936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612552.431000:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:13805:x1875495932247936:12345-0@lo:502:llog_process_th.0 Request processed in 136us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612552.431007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788612552.431086:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d04a0405-b620-42fe-8569-8c55f54b9b5e:13805:1875495932247936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612552.431514:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612552.431522:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612552.431523:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788612552.431527:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:0.0:1788612552.432946:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1788612552.433010:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788612552.433032:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612552.433043:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612552.433055:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.071698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612553.456412:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788612553.459303:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612554.097615:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612554.736909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932248064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612554.737032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612554.737135:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248064 00000100:00100000:1.0:1788612554.738857:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248064 00000100:00100000:1.0:1788612554.738915:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788612554.738925:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932248064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612554.738960:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788612554.739068:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932248064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612554.739085:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788612554.739148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932248064:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788612555.120040:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612555.352592:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612555.352636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612555.352654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612555.352685:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612555.352776:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336128 00000100:00100000:0.0:1788612555.352785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336128 00000100:00100000:0.0:1788612555.352854:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336384 00000100:00100000:3.0:1788612555.352858:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336000 00000100:00100000:0.0:1788612555.352858:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336384 00000100:00100000:3.0:1788612555.352866:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336000 00000100:00100000:0.0:1788612555.352890:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:1.0:1788612555.352929:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335872 00000100:00100000:0.0:1788612555.352929:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914336128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612555.352934:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335872 00000100:00100000:3.0:1788612555.352938:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:3.0:1788612555.352950:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914336384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612555.352967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 368 00000100:00100000:1.0:1788612555.352976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914335872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612555.352999:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914336128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 74us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.353007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914336384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 58us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.353011:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914335872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.353011:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:3.0:1788612555.353025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:1.0:1788612555.353026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 368 00000100:00080000:2.0:1788612555.353055:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612555.353059:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612555.358013:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 225 00000100:00100000:0.0:1788612555.358042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914336000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612555.358144:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914336000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 118us (5458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.358153:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 225 00000100:00100000:0.0:1788612555.358309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612555.358446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612555.358502:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336512 00000100:00100000:0.0:1788612555.358523:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336512 00000100:00100000:0.0:1788612555.358571:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:0.0:1788612555.358577:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914336512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612555.358610:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914336512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.358616:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00080000:0.0:1788612555.358642:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612555.358686:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336256 00000100:00100000:0.0:1788612555.358690:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336256 00000100:00100000:0.0:1788612555.358730:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00080000:1.0:1788612555.358731:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612555.358737:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914336256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612555.358806:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914336256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.358814:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00010000:00010000:3.0:1788612556.144972:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612556.272016:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932248320:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.272118:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932248192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612556.272134:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932248448:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.272187:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612556.272222:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612556.272245:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932248704:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.272253:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932248960:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.272275:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612556.272309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932249216:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.272330:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612556.272335:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612556.272345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932249728:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.272365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612556.272384:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788612556.272390:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932248576:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.272417:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612556.272437:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932249088:0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.272448:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249216 00000100:00100000:3.0:1788612556.272457:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249216 00000100:00100000:1.0:1788612556.272461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612556.272536:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249728 00000100:00100000:3.0:1788612556.272540:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249728 00000100:00100000:3.0:1788612556.272561:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788612556.272571:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932249216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.272622:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932249216:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.272631:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788612556.272631:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932248832:0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.272651:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788612556.272659:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fee30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932249728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.272667:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612556.272701:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932249344:0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.272712:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fee30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932249728:12345-0@lo:400:kworker.0 Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.272719:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788612556.272729:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612556.272753:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932249856:0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.272778:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612556.272798:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612556.272806:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932249984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612556.272832:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612556.272885:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248576 00000100:00100000:0.0:1788612556.272890:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248576 00000100:00100000:0.0:1788612556.272920:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248832 00000100:00100000:0.0:1788612556.272930:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248832 00000100:00100000:3.0:1788612556.272936:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249344 00000100:00100000:3.0:1788612556.272942:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249344 00000100:00100000:0.0:1788612556.272957:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788612556.272966:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.272967:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249856 00000100:00100000:3.0:1788612556.272973:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249856 00000100:00100000:3.0:1788612556.272991:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788612556.273001:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932249344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.273009:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932248576:12345-0@lo:400:kworker.0 Request processed in 44us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612556.273017:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788612556.273045:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932249344:12345-0@lo:400:kworker.0 Request processed in 46us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.273052:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788612556.273065:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612556.273070:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932249856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.273096:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932249856:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.273102:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612556.273180:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248192 00000100:00100000:3.0:1788612556.273191:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248192 00000100:00100000:3.0:1788612556.273216:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249984 00000100:00100000:3.0:1788612556.273219:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249984 00000100:00100000:3.0:1788612556.273231:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788612556.273237:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932248192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612556.273259:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612556.273288:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932248192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.273294:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788612556.273304:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788612556.273309:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932249984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612556.273317:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612556.273337:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932249984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.273342:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788612556.273929:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788612556.273940:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932248832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.273981:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932248832:12345-0@lo:400:kworker.0 Request processed in 44us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612556.273987:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788612556.274007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248320 00000100:00100000:0.0:1788612556.274011:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248320 00000100:00100000:0.0:1788612556.274047:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788612556.274054:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932248320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.274083:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932248320:12345-0@lo:400:kworker.0 Request processed in 30us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612556.274090:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:0.0:1788612556.274136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612556.274141:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788612556.274195:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880e00 x1875495932249984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612556.274212:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932249984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612556.274224:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932248832:0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.274234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932249344:0@lo:400:kworker.0 00010000:00080000:0.0:1788612556.274257:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c12ace00 x1875495932249856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612556.274266:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932249856:0@lo:400:kworker.0 00000100:00100000:0.0:1788612556.274274:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932248320:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248448 00000100:00100000:3.0:1788612556.275499:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248704 00000100:00100000:3.0:1788612556.275507:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248704 00000100:00100000:2.0:1788612556.275507:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248448 00000100:00100000:1.0:1788612556.275539:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932249600:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275547:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249088 00000100:00100000:3.0:1788612556.275551:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788612556.275552:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249088 00000100:00100000:3.0:1788612556.275559:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932248448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275576:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788612556.275587:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.275589:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612556.275608:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932248448:12345-0@lo:400:kworker.0 Request processed in 49us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.275617:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788612556.275629:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932248704:12345-0@lo:400:kworker.0 Request processed in 47us (3355us total) trans 0 rc 0/0 00010000:00080000:1.0:1788612556.275632:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed4c700 x1875495932248192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612556.275633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249600 00000100:00100000:3.0:1788612556.275637:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249600 00000100:00100000:2.0:1788612556.275638:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788612556.275653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788612556.275658:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932248192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612556.275659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788612556.275659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932249088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.275667:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932249600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.275683:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932248704:0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.275715:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932249600:12345-0@lo:400:kworker.0 Request processed in 47us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612556.275715:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932249088:12345-0@lo:400:kworker.0 Request processed in 54us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.275716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932249216:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788612556.275734:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00080000:1.0:1788612556.275742:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78fe300 x1875495932249728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612556.275752:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612556.275753:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932249728:0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.275784:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612556.275812:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932249472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275825:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932248960 00000100:00100000:2.0:1788612556.275829:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932248960 00000100:00100000:3.0:1788612556.275835:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612556.275851:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932249472 00000100:00100000:2.0:1788612556.275854:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932249472 00000100:00100000:3.0:1788612556.275861:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932248448:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275871:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788612556.275876:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932248960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.275879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788612556.275885:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932249472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.275908:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932249472:12345-0@lo:400:kworker.0 Request processed in 23us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612556.275908:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932248960:12345-0@lo:400:kworker.0 Request processed in 31us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.275914:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788612556.275925:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:3.0:1788612556.275934:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612556.275946:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932248960:0@lo:400:kworker.0 00000100:00100000:2.0:1788612556.275957:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932249472:0@lo:400:kworker.0 00000100:00100000:1.0:1788612556.277230:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932248576:0@lo:400:kworker.0 00010000:00080000:1.0:1788612556.277257:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78ff480 x1875495932249088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612556.277268:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932249088:0@lo:400:kworker.0 00010000:00080000:1.0:1788612556.277297:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78ff800 x1875495932249600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612556.277306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932249600:0@lo:400:kworker.0 00000100:00100000:3.0:1788612556.783702:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612556.783725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932250112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612556.783796:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612556.783863:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250112 00000100:00100000:3.0:1788612556.783870:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250112 00000100:00100000:3.0:1788612556.783915:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788612556.783924:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932250112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612556.783951:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612556.784002:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932250112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.784008:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788612556.784101:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932250112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612556.785812:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932250240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612556.785866:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612556.786276:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612556.786291:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932250368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612556.786319:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612556.786385:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250368 00000100:00100000:1.0:1788612556.786393:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250368 00000100:00100000:1.0:1788612556.786437:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788612556.786446:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932250368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612556.786463:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612556.786526:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932250368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.786533:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788612556.786612:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932250368:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788612556.787970:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1788612556.788058:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250240 00000100:00100000:0.0:1788612556.788067:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250240 00000100:00100000:0.0:1788612556.788173:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788612556.788186:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932250240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612556.788219:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612556.788326:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932250240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612556.788333:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788612556.788418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932250240:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788612557.167864:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612558.193898:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612559.221843:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612559.855892:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932250496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612559.855962:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612559.856234:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250496 00000100:00100000:1.0:1788612559.856243:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250496 00000100:00100000:1.0:1788612559.856298:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788612559.856308:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932250496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612559.856352:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788612559.856416:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932250496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612559.856423:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612559.856620:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932250496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612560.239795:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612560.472791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612560.472837:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612560.472864:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612560.472898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612560.472918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612560.472938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612560.473017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336640 00000100:00100000:2.0:1788612560.473027:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336640 00000100:00100000:2.0:1788612560.473085:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 370 00000100:00100000:2.0:1788612560.473095:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914336640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612560.473164:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914336640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612560.473172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 370 00000100:00100000:3.0:1788612560.473394:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336896 00000100:00100000:3.0:1788612560.473399:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336896 00000100:00100000:3.0:1788612560.473456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337152 00000100:00100000:3.0:1788612560.473459:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337152 00000100:00100000:3.0:1788612560.473472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336768 00000100:00100000:3.0:1788612560.473512:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336768 00000100:00100000:3.0:1788612560.473529:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337280 00000100:00100000:3.0:1788612560.473532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337280 00000100:00100000:3.0:1788612560.473545:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:3.0:1788612560.473552:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914336896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.473590:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914336896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.473597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:3.0:1788612560.473610:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:3.0:1788612560.473617:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914337152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.473641:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914337152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.473729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:3.0:1788612560.473744:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:3.0:1788612560.473751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914336768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.473777:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914336768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.473782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:3.0:1788612560.473794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:3.0:1788612560.473800:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914337280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.473822:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914337280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.473829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:3.0:1788612560.473850:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337024 00000100:00100000:3.0:1788612560.473853:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337024 00000100:00100000:3.0:1788612560.473880:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:3.0:1788612560.473886:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914337024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.473911:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914337024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.473917:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00080000:2.0:1788612560.474118:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612560.474123:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612560.474125:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788612561.263698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612561.391713:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932250752:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.391764:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932251008:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.391789:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.391811:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250752 00000100:00100000:2.0:1788612561.391817:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250752 00000100:00100000:3.0:1788612561.391842:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932251264:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.391864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.391864:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788612561.391873:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932250752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.391883:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932251776:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.391916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.391916:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932250752:12345-0@lo:400:kworker.0 Request processed in 45us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.391923:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788612561.391938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251264 00000100:00100000:2.0:1788612561.391941:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251264 00000100:00100000:3.0:1788612561.391946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932250752:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.391961:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788612561.391966:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251776 00000100:00100000:3.0:1788612561.391967:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932250624:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.391968:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251776 00000100:00100000:2.0:1788612561.391982:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788612561.391987:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932251264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.391992:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.392011:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932251136:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392012:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932251264:12345-0@lo:400:kworker.0 Request processed in 25us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392018:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788612561.392029:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788612561.392031:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.392034:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932251776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392048:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932251648:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392069:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.392085:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.392127:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932251264:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392157:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251136 00000100:00100000:3.0:1788612561.392160:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251136 00000100:00100000:3.0:1788612561.392185:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788612561.392191:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932251136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392213:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932251776:12345-0@lo:400:kworker.0 Request processed in 178us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612561.392221:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932251136:12345-0@lo:400:kworker.0 Request processed in 31us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392221:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788612561.392226:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788612561.392238:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612561.392239:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251648 00000100:00100000:3.0:1788612561.392242:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251648 00000100:00100000:2.0:1788612561.392248:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.392264:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932251520:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392266:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252160 00000100:00100000:3.0:1788612561.392268:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252160 00000100:00100000:3.0:1788612561.392285:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788612561.392286:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.392291:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932251648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392296:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932252032:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392321:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.392334:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788612561.392339:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932251648:12345-0@lo:400:kworker.0 Request processed in 48us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392339:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932250880:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392345:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788612561.392354:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251520 00000100:00100000:3.0:1788612561.392357:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251520 00000100:00100000:2.0:1788612561.392358:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.392370:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252032 00000100:00100000:2.0:1788612561.392372:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932251392:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392373:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252032 00000100:00100000:2.0:1788612561.392391:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.392395:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788612561.392401:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932252160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392405:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932251904:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392424:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.392444:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251008 00000100:00100000:2.0:1788612561.392448:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251008 00000100:00100000:3.0:1788612561.392451:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932252160:12345-0@lo:400:kworker.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612561.392457:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788612561.392464:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251392 00000100:00100000:3.0:1788612561.392466:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788612561.392466:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251392 00000100:00100000:3.0:1788612561.392471:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932251520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392496:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932251904 00000100:00100000:2.0:1788612561.392498:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932251904 00000100:00100000:2.0:1788612561.392512:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788612561.392518:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932251008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392535:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932251520:12345-0@lo:400:kworker.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612561.392542:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788612561.392542:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932251008:12345-0@lo:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392547:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788612561.392552:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788612561.392557:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932252032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392557:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788612561.392561:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932251392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392582:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932252032:12345-0@lo:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392582:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932251392:12345-0@lo:400:kworker.0 Request processed in 20us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392588:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788612561.392589:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788612561.392599:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788612561.392604:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932251904:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788612561.392629:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c12ad180 x1875495932251392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612561.392636:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932251904:12345-0@lo:400:kworker.0 Request processed in 32us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612561.392640:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932251392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392641:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:3.0:1788612561.392649:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c12adf80 x1875495932251904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612561.392669:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612561.392673:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612561.392675:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612561.392676:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932251904:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392683:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250880 00000100:00100000:2.0:1788612561.392686:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250880 00000100:00100000:3.0:1788612561.392688:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932251008:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392696:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932251520:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392701:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00010000:00080000:3.0:1788612561.392705:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c12adc00 x1875495932252032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612561.392706:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932250880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392713:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932252032:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392739:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932251136:0@lo:400:kworker.0 00000100:00100000:2.0:1788612561.392740:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932250880:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.392746:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788612561.392747:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788612561.392751:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9612fe941500, transno 4294967301 00000100:00100000:3.0:1788612561.392760:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932251648:0@lo:400:kworker.0 00010000:00080000:3.0:1788612561.392771:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c12af800 x1875495932252160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612561.392774:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932250880:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392779:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788612561.392788:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932251776:0@lo:400:kworker.0 00000100:00100000:0.0:1788612561.392961:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932250624 00000100:00100000:0.0:1788612561.392966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932250624 00000100:00100000:0.0:1788612561.392997:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788612561.393004:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932250624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612561.393056:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932250624:12345-0@lo:400:kworker.0 Request processed in 42us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612561.393068:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788612561.393073:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932252288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612561.393098:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612561.393116:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252288 00000100:00100000:0.0:1788612561.393119:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252288 00000100:00100000:3.0:1788612561.393120:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932250624:0@lo:400:kworker.0 00000100:00100000:0.0:1788612561.393167:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788612561.393174:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932252288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612561.393193:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612561.393228:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932252288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612561.393234:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1788612561.393290:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7840000 x1875495932252288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612561.393304:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932252288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612561.393652:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932252416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612561.393691:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612561.393732:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252416 00000100:00100000:3.0:1788612561.393737:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252416 00000100:00100000:3.0:1788612561.393766:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788612561.393773:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932252416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612561.393784:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612561.393828:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932252416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612561.393834:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1788612561.393895:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78ff480 x1875495932252416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612561.393906:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932252416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612561.903684:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612561.903708:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932252544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612561.903775:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612561.903848:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252544 00000100:00100000:2.0:1788612561.903855:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252544 00000100:00100000:2.0:1788612561.903895:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788612561.903903:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932252544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612561.903945:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612561.903983:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932252544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.903989:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788612561.904031:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932252544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612561.904582:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932252672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612561.904621:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612561.904718:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252672 00000100:00100000:1.0:1788612561.904723:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252672 00000100:00100000:1.0:1788612561.904763:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612561.904770:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932252672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612561.904791:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612561.904837:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932252672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612561.905141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932252672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612561.905224:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788612561.905361:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932252800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612561.905392:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612561.905561:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252800 00000100:00100000:0.0:1788612561.905566:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252800 00000100:00100000:0.0:1788612561.905602:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788612561.905610:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932252800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612561.905623:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612561.905674:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932252800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612561.905682:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612561.905764:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932252800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788612562.291708:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612563.311859:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612563.696385:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788612563.697748:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788612564.335783:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612564.976291:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612564.977001:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c1325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932252928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612564.977457:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612564.983012:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932252928 00000100:00100000:2.0:1788612564.983028:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932252928 00000100:00100000:2.0:1788612564.983177:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788612564.983190:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932252928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612564.983238:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788612564.983332:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932252928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (5874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612564.983340:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788612564.983437:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c1325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932252928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788612565.360667:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612565.600064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612565.600115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612565.600233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612565.601055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337408 00000100:00100000:1.0:1788612565.601066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337408 00000100:00100000:1.0:1788612565.601127:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 372 00000100:00100000:1.0:1788612565.601138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914337408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612565.601206:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914337408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.601214:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 372 00000100:00100000:2.0:1788612565.609795:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337664 00000100:00100000:2.0:1788612565.609809:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337664 00000100:00100000:2.0:1788612565.609875:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337536 00000100:00100000:2.0:1788612565.609880:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337536 00000100:00100000:2.0:1788612565.609911:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:2.0:1788612565.609923:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914337664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612565.610030:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:1.0:1788612565.610042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914337536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612565.610122:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914337536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 83us (9888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.610130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:2.0:1788612565.610681:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914337664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 759us (10564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612565.610687:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00080000:3.0:1788612565.610811:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612565.610816:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612565.632001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612565.634787:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337792 00000100:00100000:0.0:1788612565.634801:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337792 00000100:00100000:0.0:1788612565.634966:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1788612565.634977:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2393:x1875495914337792:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:0.0:1788612565.635007:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc81db 00000100:00080000:0.0:1788612565.635037:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9611c7a6f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612565.635086:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788612565.635249:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+2:2393:x1875495914337792:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 273us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612565.635257:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00010000:00010000:2.0:1788612565.636749:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612565.641772:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612565.641891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612565.641951:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612565.642132:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338048 00000100:00100000:2.0:1788612565.642142:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338048 00000100:00100000:2.0:1788612565.642209:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337920 00000100:00100000:2.0:1788612565.642226:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337920 00000100:00100000:2.0:1788612565.642256:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:2.0:1788612565.642266:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914338048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612565.642335:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914338048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612565.642343:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:2.0:1788612565.642365:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:2.0:1788612565.642373:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914337920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612565.642400:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914337920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612565.642406:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00080000:1.0:1788612565.642552:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612565.642556:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788612566.383798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612566.512024:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932253312:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512089:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.512137:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932253824:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512163:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.512184:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932254336:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512204:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.512230:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788612566.512235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512256:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.512272:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932253696:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512291:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.512305:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932254208:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512323:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.512365:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253824 00000100:00100000:2.0:1788612566.512372:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253824 00000100:00100000:2.0:1788612566.512416:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254336 00000100:00100000:2.0:1788612566.512419:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254336 00000100:00100000:2.0:1788612566.512435:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253184 00000100:00100000:2.0:1788612566.512438:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253184 00000100:00100000:2.0:1788612566.512450:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253696 00000100:00100000:2.0:1788612566.512452:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253696 00000100:00100000:2.0:1788612566.512462:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254208 00000100:00100000:2.0:1788612566.512464:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254208 00000100:00100000:2.0:1788612566.512500:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788612566.512509:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932253824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512572:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932253824:12345-0@lo:400:kworker.0 Request processed in 64us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612566.512579:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788612566.512597:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788612566.512603:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932254336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512639:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932254336:12345-0@lo:400:kworker.0 Request processed in 37us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612566.512645:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788612566.512659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788612566.512665:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932253184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512689:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932253184:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612566.512694:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788612566.512705:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788612566.512710:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932253696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512733:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932253696:12345-0@lo:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612566.512744:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788612566.512775:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788612566.512781:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512810:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932254208:12345-0@lo:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612566.512815:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788612566.512855:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932253184:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512867:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932253696:0@lo:400:kworker.0 00000100:00100000:2.0:1788612566.512877:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932254208:0@lo:400:kworker.0 00010000:00080000:2.0:1788612566.512887:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c12afb80 x1875495932253824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612566.512896:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932253824:0@lo:400:kworker.0 00010000:00080000:2.0:1788612566.512906:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692d180 x1875495932254336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612566.512913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932254336:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513017:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932253440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513048:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513081:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932253952:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513104:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932254464:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513140:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513164:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788612566.513170:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932253056:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513219:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932253568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513241:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513256:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932254080:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513276:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513292:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932254592:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513311:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.513337:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253952 00000100:00100000:0.0:1788612566.513341:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253952 00000100:00100000:0.0:1788612566.513366:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254464 00000100:00100000:0.0:1788612566.513369:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254464 00000100:00100000:0.0:1788612566.513381:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254080 00000100:00100000:0.0:1788612566.513390:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254080 00000100:00100000:0.0:1788612566.513406:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254592 00000100:00100000:0.0:1788612566.513408:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254592 00000100:00100000:0.0:1788612566.513422:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788612566.513428:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932253952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513462:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932253952:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513468:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788612566.513517:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788612566.513524:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932254464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513554:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932254464:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513560:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788612566.513571:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788612566.513576:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932254080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513601:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932254080:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513607:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788612566.513616:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788612566.513635:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932254592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513662:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932254592:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513667:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788612566.513685:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253056 00000100:00100000:0.0:1788612566.513689:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253056 00000100:00100000:0.0:1788612566.513710:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788612566.513716:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932253056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513752:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932253056:12345-0@lo:400:kworker.0 Request processed in 36us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513758:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788612566.513785:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253312 00000100:00100000:0.0:1788612566.513789:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253312 00000100:00100000:0.0:1788612566.513805:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253568 00000100:00100000:0.0:1788612566.513807:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253568 00000100:00100000:0.0:1788612566.513818:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788612566.513823:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932253312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513858:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932253312:12345-0@lo:400:kworker.0 Request processed in 34us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513864:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788612566.513876:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788612566.513882:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932253568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513910:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932253568:12345-0@lo:400:kworker.0 Request processed in 29us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.513916:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788612566.513968:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932253056:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513978:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932253568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.513987:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932254080:0@lo:400:kworker.0 00010000:00080000:0.0:1788612566.513997:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692d880 x1875495932254592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612566.514006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932254592:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.514015:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932253952:0@lo:400:kworker.0 00010000:00080000:0.0:1788612566.514033:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c692df80 x1875495932254464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612566.514042:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932254464:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.514069:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932253440 00000100:00100000:0.0:1788612566.514073:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932253440 00000100:00100000:0.0:1788612566.514096:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788612566.514102:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932253440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.514136:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932253440:12345-0@lo:400:kworker.0 Request processed in 34us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.514142:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788612566.514167:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932253440:0@lo:400:kworker.0 00000100:00080000:1.0:1788612566.515828:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612566.515835:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612566.515852:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612566.515855:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612566.517812:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932254720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612566.517881:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612566.518369:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932253312:0@lo:400:kworker.0 00000100:00100000:0.0:1788612566.518449:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254720 00000100:00100000:0.0:1788612566.518457:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254720 00000100:00100000:0.0:1788612566.518534:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788612566.518544:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932254720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612566.518571:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612566.518634:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932254720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.518641:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1788612566.519819:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78fc000 x1875495932254720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612566.519838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932254720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612566.520049:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612566.520061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932254848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612566.520108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612566.522117:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254848 00000100:00100000:0.0:1788612566.522129:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254848 00000100:00100000:0.0:1788612566.522193:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788612566.522203:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932254848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612566.522228:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612566.522302:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932254848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612566.522321:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788612566.522433:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880e00 x1875495932254848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612566.522465:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932254848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612567.024126:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932254976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612567.024209:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612567.024400:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932255104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612567.024434:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612567.024469:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255104 00000100:00100000:3.0:1788612567.024499:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255104 00000100:00100000:3.0:1788612567.024544:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788612567.024553:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932255104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612567.024578:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612567.024633:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932255104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612567.024639:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788612567.024683:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932255104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612567.024840:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932254976 00000100:00100000:2.0:1788612567.024844:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932254976 00000100:00100000:2.0:1788612567.024894:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788612567.024901:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932254976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612567.024929:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612567.024972:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932254976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612567.024978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788612567.025049:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932254976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612567.027098:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932255232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612567.027157:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612567.027321:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255232 00000100:00100000:1.0:1788612567.027328:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255232 00000100:00100000:1.0:1788612567.027382:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788612567.027391:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932255232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612567.027410:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612567.027460:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932255232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612567.027466:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612567.027629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932255232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788612567.410847:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612568.431893:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612569.455756:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612570.095956:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932255360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612570.096029:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612570.096195:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255360 00000100:00100000:0.0:1788612570.096203:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255360 00000100:00100000:0.0:1788612570.096247:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788612570.096256:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932255360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612570.096286:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788612570.096337:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932255360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612570.096344:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788612570.096549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932255360:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788612570.479950:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612570.716036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612570.716084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612570.716114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612570.716142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612570.716165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612570.716178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338176 00000100:00100000:2.0:1788612570.716188:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338176 00000100:00100000:0.0:1788612570.716201:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338304 00000100:00100000:0.0:1788612570.716204:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338304 00000100:00100000:2.0:1788612570.716235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 374 00000100:00100000:0.0:1788612570.716235:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338560 00000100:00100000:0.0:1788612570.716237:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338560 00000100:00100000:2.0:1788612570.716244:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914338176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612570.716248:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338432 00000100:00100000:0.0:1788612570.716250:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338432 00000100:00100000:0.0:1788612570.716259:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338688 00000100:00100000:0.0:1788612570.716261:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338688 00000100:00100000:0.0:1788612570.716290:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:0.0:1788612570.716296:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914338304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612570.716305:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914338176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 62us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612570.716313:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 374 00000100:00100000:0.0:1788612570.716324:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914338304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612570.716330:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:0.0:1788612570.716341:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:0.0:1788612570.716346:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914338560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612570.716348:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:2.0:1788612570.716354:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914338432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612570.716368:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914338560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612570.716372:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914338432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 19us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612570.716374:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:2.0:1788612570.716383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:0.0:1788612570.721683:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:0.0:1788612570.721713:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914338688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612570.721813:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914338688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 117us (5646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612570.721822:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00080000:0.0:1788612570.721959:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612570.721964:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788612571.503629:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612571.631842:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932255488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612571.631918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612571.632252:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255488 00000100:00100000:1.0:1788612571.632261:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255488 00000100:00100000:1.0:1788612571.632332:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612571.632342:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932255488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612571.632371:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612571.632431:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932255488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612571.632439:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788612571.632564:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788612571.632603:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880e00 x1875495932255488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612571.632622:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932255488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612571.635209:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932255744:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635275:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612571.635307:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932256256:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635331:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612571.635355:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932256768:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635377:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612571.635412:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788612571.635418:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932255872:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612571.635458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932256384:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612571.635528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932256896:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635549:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612571.635580:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255744 00000100:00100000:3.0:1788612571.635597:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255744 00000100:00100000:3.0:1788612571.635632:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256256 00000100:00100000:3.0:1788612571.635635:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256256 00000100:00100000:3.0:1788612571.635652:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256768 00000100:00100000:3.0:1788612571.635654:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256768 00000100:00100000:3.0:1788612571.635666:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256384 00000100:00100000:3.0:1788612571.635668:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256384 00000100:00100000:3.0:1788612571.635677:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256896 00000100:00100000:3.0:1788612571.635679:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256896 00000100:00100000:3.0:1788612571.635691:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788612571.635697:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932255744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635744:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932255744:12345-0@lo:400:kworker.0 Request processed in 47us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612571.635750:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788612571.635784:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932255744:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635803:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788612571.635809:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932256256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.635963:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932256256:12345-0@lo:400:kworker.0 Request processed in 154us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612571.635969:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788612571.635992:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932256256:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.636010:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788612571.636017:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932256768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.636050:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932256768:12345-0@lo:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612571.636064:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788612571.636088:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932256768:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.636106:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788612571.636112:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932256384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.636143:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932256384:12345-0@lo:400:kworker.0 Request processed in 31us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612571.636148:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:3.0:1788612571.636169:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7addc00 x1875495932256384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612571.636180:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932256384:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.636197:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788612571.636203:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932256896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.636235:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932256896:12345-0@lo:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612571.636240:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:3.0:1788612571.636261:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f4a80 x1875495932256896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612571.636269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932256896:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636664:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932256000:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636699:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612571.636724:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932256512:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636749:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612571.636765:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932257024:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636798:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612571.636832:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788612571.636839:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612571.636883:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932256128:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636906:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612571.636920:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932256640:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.636940:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612571.637562:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256000 00000100:00100000:0.0:1788612571.637576:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256000 00000100:00100000:0.0:1788612571.637632:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788612571.637640:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932256000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.637684:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932256000:12345-0@lo:400:kworker.0 Request processed in 45us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.637691:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788612571.637715:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255872 00000100:00100000:0.0:1788612571.637718:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255872 00000100:00100000:0.0:1788612571.637735:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256128 00000100:00100000:0.0:1788612571.637738:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256128 00000100:00100000:0.0:1788612571.637750:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612571.637755:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932255872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.637791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932255872:12345-0@lo:400:kworker.0 Request processed in 35us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.637797:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612571.637808:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612571.637814:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932256128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.637842:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932256128:12345-0@lo:400:kworker.0 Request processed in 28us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.637847:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612571.637876:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256512 00000100:00100000:0.0:1788612571.637880:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256512 00000100:00100000:0.0:1788612571.637906:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257024 00000100:00100000:0.0:1788612571.637909:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257024 00000100:00100000:0.0:1788612571.637919:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932256640 00000100:00100000:0.0:1788612571.637921:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932256640 00000100:00100000:0.0:1788612571.637932:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788612571.637937:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932256512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.637976:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932256512:12345-0@lo:400:kworker.0 Request processed in 38us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.637982:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788612571.637995:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788612571.638000:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932257024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.638026:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932257024:12345-0@lo:400:kworker.0 Request processed in 26us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.638032:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788612571.638041:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788612571.638047:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.638073:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932256640:12345-0@lo:400:kworker.0 Request processed in 26us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.638078:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612571.638079:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932255616 00000100:00100000:1.0:1788612571.638083:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932255616 00000100:00080000:0.0:1788612571.638095:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612571.638098:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612571.638101:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612571.638103:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612571.638111:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788612571.638118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932255616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612571.638126:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932257152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612571.638151:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932255616:12345-0@lo:400:kworker.0 Request processed in 34us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612571.638151:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612571.638157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788612571.638263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.638276:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932256128:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.638287:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932256640:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.638295:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932256000:0@lo:400:kworker.0 00000100:00100000:2.0:1788612571.638304:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932256512:0@lo:400:kworker.0 00010000:00080000:2.0:1788612571.638314:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f5f80 x1875495932257024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612571.638334:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932257024:0@lo:400:kworker.0 00000100:00100000:3.0:1788612571.638521:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257152 00000100:00100000:3.0:1788612571.638526:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257152 00000100:00100000:3.0:1788612571.638559:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788612571.638566:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932257152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612571.638581:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612571.638635:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932257152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612571.638640:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788612571.639522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932255872:0@lo:400:kworker.0 00010000:00080000:0.0:1788612571.640677:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78bdc00 x1875495932257152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612571.640699:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932257152:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1788612571.644063:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:3.0:1788612571.644071:0:8434:0:(genops.c:885:class_export_put()) final put ffff9611c7a6e000/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:0.0:1788612571.644504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a6e000/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-OST0000 00000020:00000080:0.0:1788612571.644569:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7a6f000 for lustre-OST0000 00000100:00100000:2.0:1788612572.143675:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612572.143696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932257280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612572.143761:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612572.143838:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257280 00000100:00100000:2.0:1788612572.143845:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257280 00000100:00100000:2.0:1788612572.143901:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788612572.143910:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932257280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612572.143939:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612572.143983:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932257280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612572.143990:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788612572.144037:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932257280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612572.144387:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612572.144398:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932257408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612572.144429:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612572.144531:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257408 00000100:00100000:2.0:1788612572.144536:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257408 00000100:00100000:2.0:1788612572.144569:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788612572.144602:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932257408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612572.144613:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612572.144645:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932257408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612572.144651:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788612572.144795:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932257408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612572.149313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932257536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612572.149387:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612572.149512:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257536 00000100:00100000:1.0:1788612572.149520:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257536 00000100:00100000:1.0:1788612572.149574:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788612572.149592:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932257536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612572.149622:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612572.149673:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932257536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612572.149680:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788612572.150283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932257536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612572.528618:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612573.564905:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612573.940508:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788612573.947184:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612574.576664:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612575.216361:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612575.216385:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932257664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612575.216456:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612575.216768:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257664 00000100:00100000:1.0:1788612575.216776:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257664 00000100:00100000:1.0:1788612575.216825:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788612575.216993:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932257664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612575.217029:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788612575.217120:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932257664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612575.217127:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788612575.217761:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932257664:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612575.599837:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612575.842492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612575.842527:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612575.842647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612575.842672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612575.842702:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612575.842734:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339072 00000100:00100000:1.0:1788612575.842735:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339328 00000100:00100000:0.0:1788612575.842743:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339072 00000100:00100000:1.0:1788612575.842750:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339328 00000100:00100000:0.0:1788612575.842803:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338944 00000100:00100000:0.0:1788612575.842808:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338944 00000100:00100000:2.0:1788612575.842917:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338816 00000100:00100000:2.0:1788612575.842922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338816 00000100:00100000:2.0:1788612575.842953:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 376 00000100:00100000:2.0:1788612575.842963:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914338816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612575.843049:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914338816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 87us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612575.843058:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 376 00000100:00100000:2.0:1788612575.843589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339200 00000100:00100000:2.0:1788612575.843594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339200 00000100:00100000:1.0:1788612575.846848:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 263 00000100:00100000:1.0:1788612575.846877:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914339072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612575.846961:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914339072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 100us (4432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612575.846968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 263 00000100:00100000:1.0:1788612575.846987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 264 00000100:00100000:1.0:1788612575.847014:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914339328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612575.847043:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914339328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612575.847049:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 264 00000100:00100000:0.0:1788612575.847583:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 265 00000100:00100000:0.0:1788612575.847594:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914338944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612575.847645:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914338944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 54us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612575.847652:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 265 00000100:00080000:0.0:1788612575.847669:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612575.847673:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612575.847927:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 266 00000100:00100000:2.0:1788612575.847936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914339200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612575.847970:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914339200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (5267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612575.847975:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 266 00010000:00010000:0.0:1788612576.624443:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612576.751939:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612576.751964:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932257920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612576.752032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612576.752168:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257920 00000100:00100000:0.0:1788612576.752177:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257920 00000100:00100000:0.0:1788612576.752238:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612576.752248:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932257920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612576.752274:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612576.752318:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932257920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612576.752325:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788612576.752354:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612576.753406:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864a80 x1875495932257920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612576.753431:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932257920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612576.753442:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932257792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612576.753511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612576.753614:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932257792 00000100:00100000:3.0:1788612576.753621:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932257792 00000100:00100000:3.0:1788612576.753686:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788612576.753695:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932257792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612576.753712:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612576.753747:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932257792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612576.753754:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788612576.753773:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612576.754394:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932258304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612576.754446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612576.754539:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258304 00000100:00100000:0.0:1788612576.754562:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258304 00000100:00100000:3.0:1788612576.754591:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932258048:0@lo:400:kworker.0 00000100:00100000:0.0:1788612576.754603:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788612576.754613:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932258304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.754630:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612576.754673:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932258304:12345-0@lo:400:kworker.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612576.754680:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788612576.754720:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932258176:0@lo:400:kworker.0 00000100:00100000:0.0:1788612576.754747:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788612576.757203:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c78bc380 x1875495932257792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612576.757203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932258304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612576.757217:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932258816:0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.757223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932257792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612576.757252:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932258432:0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.757279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612576.757315:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.757341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612576.757383:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258944 00000100:00100000:1.0:1788612576.757468:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612576.757506:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932259328:0@lo:400:kworker.0 00000100:00100000:1.0:1788612576.757606:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612576.757659:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258176 00000100:00100000:1.0:1788612576.757663:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258176 00000100:00100000:1.0:1788612576.757704:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258432 00000100:00100000:1.0:1788612576.757707:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258432 00000100:00100000:1.0:1788612576.757719:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258816 00000100:00100000:1.0:1788612576.757721:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258816 00000100:00100000:1.0:1788612576.757817:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259328 00000100:00100000:1.0:1788612576.757821:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259328 00000100:00100000:1.0:1788612576.757839:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788612576.757846:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932258176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612576.757893:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932258176:12345-0@lo:400:kworker.0 Request processed in 47us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612576.757900:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788612576.757914:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788612576.757920:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932258432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612576.758255:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932258432:12345-0@lo:400:kworker.0 Request processed in 335us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612576.758262:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788612576.758318:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258944 00000100:00100000:2.0:1788612576.758356:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612576.758364:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932258944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.758413:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932258944:12345-0@lo:400:kworker.0 Request processed in 51us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612576.758419:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612576.760379:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788612576.760808:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932258816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.760915:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932258816:12345-0@lo:400:kworker.0 Request processed in 525us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612576.760923:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788612576.760954:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788612576.760962:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932259328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.760992:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932259328:12345-0@lo:400:kworker.0 Request processed in 31us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612576.761014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00080000:2.0:1788612576.761074:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe940000 x1875495932258816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612576.761089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932258816:0@lo:400:kworker.0 00010000:00080000:2.0:1788612576.761103:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe940700 x1875495932259328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788612576.761111:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612576.761112:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932259328:0@lo:400:kworker.0 00000100:00080000:3.0:1788612576.761120:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612576.761136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258048 00000100:00100000:3.0:1788612576.761142:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258048 00000100:00100000:2.0:1788612576.761160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932258432:0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.761178:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932258944:0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.761195:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788612576.761204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932258048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.761235:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932258560:0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.761258:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932258048:12345-0@lo:400:kworker.0 Request processed in 55us (6628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612576.761266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788612576.761281:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612576.761310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932259072:0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.761313:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258560 00000100:00100000:3.0:1788612576.761318:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258560 00000100:00100000:2.0:1788612576.761339:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612576.761348:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788612576.761357:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932258560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.761377:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932258048:0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.761396:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932258560:12345-0@lo:400:kworker.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612576.761402:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788612576.761428:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259072 00000100:00100000:3.0:1788612576.761432:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259072 00000100:00100000:3.0:1788612576.761461:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788612576.761466:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932259072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.761513:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932259072:12345-0@lo:400:kworker.0 Request processed in 46us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612576.761519:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788612576.761539:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612576.761830:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932258560:0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.761839:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932259072:0@lo:400:kworker.0 00000100:00100000:0.0:1788612576.764792:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932258176:0@lo:400:kworker.0 00000100:00100000:0.0:1788612576.764808:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932258688:0@lo:400:kworker.0 00000100:00100000:0.0:1788612576.764872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612576.764916:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788612576.764951:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612576.765054:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932258688 00000100:00100000:3.0:1788612576.765062:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932258688 00000100:00100000:3.0:1788612576.765325:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259200 00000100:00100000:3.0:1788612576.765330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259200 00000100:00100000:3.0:1788612576.765355:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788612576.765363:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932258688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.765501:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788612576.765513:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932259200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612576.770126:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932259200:12345-0@lo:400:kworker.0 Request processed in 4608us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612576.770141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1788612576.770217:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612576.770842:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932259200:0@lo:400:kworker.0 00000100:00100000:3.0:1788612576.776371:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932258688:12345-0@lo:400:kworker.0 Request processed in 10999us (11488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612576.776394:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788612576.776649:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932258688:0@lo:400:kworker.0 00000100:00100000:2.0:1788612577.266088:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932259456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612577.266158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612577.267058:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259456 00000100:00100000:3.0:1788612577.267066:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259456 00000100:00100000:3.0:1788612577.267115:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788612577.267126:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932259456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612577.267156:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612577.267216:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932259456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612577.267223:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788612577.267361:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932259584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612577.267395:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612577.267444:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259584 00000100:00100000:3.0:1788612577.267448:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259584 00000100:00100000:3.0:1788612577.267472:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788612577.267495:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932259584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612577.267530:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788612577.267576:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932259584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612577.267582:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788612577.267626:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932259584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612577.267662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932259456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612577.272581:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932259712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612577.272668:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612577.273530:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259712 00000100:00100000:2.0:1788612577.273541:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259712 00000100:00100000:2.0:1788612577.273611:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788612577.273621:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932259712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612577.273647:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612577.273706:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932259712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612577.273713:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788612577.273998:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932259712:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788612577.644796:0:14064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:49:36 (1788612576) 00010000:00010000:3.0:1788612577.648098:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612578.671703:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612579.626743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612579.626840:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339456 00000100:00100000:0.0:1788612579.626850:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339456 00000100:00100000:0.0:1788612579.627021:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1788612579.627034:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:11066:x1875495914339456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612579.627054:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612579.627098:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc82bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2212d expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.627162:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc82c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.627198:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.627212:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612579.627259:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612579.627263:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612579.627299:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.627324:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc82bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2212d expref: 7 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788612579.627613:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788612579.627868:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc82c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2212d expref: 6 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.627877:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7100) 00010000:00010000:0.0:1788612579.627880:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612579.627883:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924600, rc 0) 00000100:00100000:0.0:1788612579.628050:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:11066:x1875495914339456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1019us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612579.628059:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:2.0:1788612579.637142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612579.637298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339584 00000100:00100000:3.0:1788612579.637307:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339584 00000100:00100000:3.0:1788612579.637374:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612579.637384:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:11067:x1875495914339584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612579.637403:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612579.637421:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc82c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22134 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637519:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637541:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637553:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637791:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637801:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637809:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637868:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc82de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637876:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc82de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637900:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc82de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612579.637951:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788612579.637955:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612579.637974:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc82de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637983:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637989:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.637996:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638002:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612579.638006:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638012:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638023:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7100) 00010000:00010000:3.0:1788612579.638026:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612579.638031:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638037:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc82d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638062:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638068:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638074:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638079:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612579.638081:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638088:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638095:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9611c76e7500) 00010000:00010000:3.0:1788612579.638098:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612579.638101:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638106:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc82d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638141:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc82c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22134 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638156:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc82de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22134 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.638186:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9611c76e7200) 00010000:00010000:3.0:1788612579.638189:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612579.638191:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3a00, rc 0) 00000100:00100000:3.0:1788612579.638265:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11067:x1875495914339584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 883us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612579.638273:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:2.0:1788612579.641258:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612579.641675:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339712 00000100:00100000:1.0:1788612579.641684:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339712 00000100:00100000:1.0:1788612579.641740:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1788612579.641751:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11067:x1875495914339712:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788612579.641832:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11067:x1875495914339712:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 83us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612579.641839:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612579.646063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612579.646136:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339968 00000100:00100000:3.0:1788612579.646145:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339968 00000100:00100000:3.0:1788612579.646212:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1788612579.646223:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11067:x1875495914339968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612579.646259:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612579.646282:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc82e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2213b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646374:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646389:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646403:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646442:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646460:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646509:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646806:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5c00/0x1f8616bf0bc82fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646815:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5c00/0x1f8616bf0bc82fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646822:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5c00/0x1f8616bf0bc82fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612579.646831:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788612579.646926:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646934:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646940:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646945:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612579.646949:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646956:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646967:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9611c76e7200) 00010000:00010000:3.0:1788612579.646970:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612579.646980:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.646987:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc82ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647003:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647009:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647014:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647019:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612579.647022:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647027:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647035:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9611c76e7d00) 00010000:00010000:3.0:1788612579.647038:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612579.647041:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.647047:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc82f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.649079:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc82e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2213b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.649122:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5c00/0x1f8616bf0bc82fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2213b expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612579.649131:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:3.0:1788612579.649134:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612579.649137:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5c00, rc 0) 00000100:00100000:3.0:1788612579.650068:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:11067:x1875495914339968:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 3840us (4007us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788612579.650077:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1788612579.667428:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612579.667962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340096 00000100:00100000:2.0:1788612579.667972:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340096 00000100:00100000:2.0:1788612579.668038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:2.0:1788612579.668048:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:11067:x1875495914340096:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788612579.668166:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:11067:x1875495914340096:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 119us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612579.668182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:2.0:1788612579.673280:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612579.673734:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340224 00000100:00100000:1.0:1788612579.673743:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340224 00000100:00100000:1.0:1788612579.673818:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:1.0:1788612579.673831:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:11067:x1875495914340224:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788612579.676439:0:12327:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2566us 00000100:00080000:2.0:1788612579.677335:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788612579.697122:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612579.705435:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:11067:x1875495914340224:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 31597us (32154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612579.705462:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000040:00080000:3.0:1788612580.080162:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788612580.086370:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612580.336217:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932259840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612580.336291:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612580.336682:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259840 00000100:00100000:3.0:1788612580.336690:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259840 00000100:00100000:3.0:1788612580.336785:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788612580.336795:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932259840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612580.336827:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788612580.337041:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932259840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 246us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612580.337048:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788612580.337111:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932259840:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612580.719649:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612580.959886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612580.959937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612580.959963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612580.959982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612580.960016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612580.960062:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340608 00000100:00100000:1.0:1788612580.960072:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340608 00000100:00100000:1.0:1788612580.960119:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340864 00000100:00100000:1.0:1788612580.960122:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340864 00000100:00100000:1.0:1788612580.960143:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340480 00000100:00100000:1.0:1788612580.960153:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340480 00000100:00100000:1.0:1788612580.960168:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340736 00000100:00100000:1.0:1788612580.960170:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340736 00000100:00100000:1.0:1788612580.960188:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:1.0:1788612580.960197:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914340608:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612580.960265:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914340608:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612580.960273:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:1.0:1788612580.960290:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:1.0:1788612580.960297:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914340864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612580.960338:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914340864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612580.960345:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:1.0:1788612580.960369:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:1.0:1788612580.960377:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2396:x1875495914340480:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612580.960401:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2396:x1875495914340480:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612580.960407:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:1.0:1788612580.960418:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 276 00000100:00100000:1.0:1788612580.960424:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914340736:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612580.960446:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914340736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612580.960452:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 276 00000100:00100000:2.0:1788612580.961693:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340352 00000100:00100000:2.0:1788612580.961704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340352 00000100:00100000:2.0:1788612580.961770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 378 00000100:00100000:2.0:1788612580.961780:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914340352:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612580.961831:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914340352:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612580.961838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 378 00000100:00080000:2.0:1788612580.961876:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612580.961880:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612581.703720:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612581.703802:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340992 00000100:00100000:1.0:1788612581.703818:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340992 00000100:00100000:1.0:1788612581.703895:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00080000:2.0:1788612581.703910:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612581.703916:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:11109:x1875495914340992:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612581.703937:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612581.703959:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22142 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704022:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704037:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704050:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704064:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704071:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704077:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704118:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704126:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704133:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704145:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612581.704150:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704157:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704169:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7100) 00010000:00010000:1.0:1788612581.704172:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612581.704175:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704182:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc830f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704195:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704202:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704206:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704211:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612581.704213:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704218:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704234:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9612fb831d00) 00010000:00010000:1.0:1788612581.704236:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612581.704239:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704244:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704273:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8308 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22142 expref: 10 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704282:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7100) 00010000:00010000:1.0:1788612581.704285:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612581.704289:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22142 expref: 10 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612581.704297:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ae00, rc 0) 00000100:00100000:1.0:1788612581.704374:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:11109:x1875495914340992:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 469us (662us total) trans 0 rc 301/301 00000100:00100000:1.0:1788612581.704381:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:2.0:1788612581.731688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612581.737013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341248 00000100:00100000:3.0:1788612581.737028:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341248 00000100:00100000:2.0:1788612581.742164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:2.0:1788612581.742178:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:11109:x1875495914341248:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1788612581.742239:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612581.742266:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc82c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2212d expref: 9 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742285:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c65f7100) 00010000:00010000:2.0:1788612581.742294:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612581.742354:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742367:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742390:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742404:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742411:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742417:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742929:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742939:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742946:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612581.742973:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5b49798 reply state 000000007c81411d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742984:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.742990:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:2.0:1788612581.742993:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612581.742996:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788612581.743000:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788612581.743007:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.743019:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.743026:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.743032:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612581.743036:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.743044:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.743053:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:2.0:1788612581.743056:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612581.743059:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.743065:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc831d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612581.746197:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5b49798 reply state 000000007c81411d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.746223:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612581.746232:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9612c8ef5800) 00010000:00010000:2.0:1788612581.746236:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612581.746239:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788612581.746363:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:11109:x1875495914341248:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 4184us (14680us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788612581.746383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00010000:00010000:1.0:1788612581.747418:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612581.873136:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612581.873157:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932259968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612581.873223:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.873551:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932259968 00000100:00100000:3.0:1788612581.873559:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932259968 00000100:00100000:3.0:1788612581.873609:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788612581.873618:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932259968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612581.873648:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612581.873694:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932259968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612581.873701:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788612581.873722:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932260096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612581.873747:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612581.873781:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612581.873791:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260096 00000100:00100000:3.0:1788612581.873794:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260096 00000100:00100000:3.0:1788612581.873831:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788612581.873838:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932260096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612581.873848:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612581.873876:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932260096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612581.873882:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:3.0:1788612581.873914:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7864e00 x1875495932259968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612581.873930:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932259968:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788612581.873960:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788612581.873975:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f7b80 x1875495932260096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612581.874000:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932260096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612581.876957:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932260224:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.877037:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612581.877228:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260224 00000100:00100000:2.0:1788612581.877236:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260224 00000100:00100000:2.0:1788612581.877281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788612581.877290:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932260224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.877350:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932260224:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.877358:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788612581.877569:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932260224:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.877579:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932260736:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.877611:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.877637:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932261248:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.877661:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.877694:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788612581.877702:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932260608:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.877727:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612581.877910:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260736 00000100:00100000:2.0:1788612581.877915:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260736 00000100:00100000:2.0:1788612581.877944:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788612581.877950:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932260736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.877988:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932260736:12345-0@lo:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.877995:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788612581.878405:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932261120:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878432:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.878465:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932260736:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932260352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878546:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.878567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932260864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878586:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.878600:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878617:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.878633:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788612581.878638:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932260480:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.878681:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932260992:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612581.878713:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932261504:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.878729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612581.878844:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932261248 00000100:00100000:2.0:1788612581.878849:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932261248 00000100:00100000:2.0:1788612581.878885:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932261120 00000100:00100000:2.0:1788612581.878889:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932261120 00000100:00100000:2.0:1788612581.878908:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612581.878916:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932261248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.878957:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932261248:12345-0@lo:400:kworker.0 Request processed in 41us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.878972:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612581.878987:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788612581.878993:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932261120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879021:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932261120:12345-0@lo:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879027:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788612581.879042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260608 00000100:00100000:2.0:1788612581.879046:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260608 00000100:00100000:2.0:1788612581.879062:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260352 00000100:00100000:2.0:1788612581.879065:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260352 00000100:00100000:2.0:1788612581.879252:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260864 00000100:00100000:2.0:1788612581.879256:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260864 00000100:00100000:2.0:1788612581.879268:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932261376 00000100:00100000:2.0:1788612581.879271:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932261376 00000100:00100000:2.0:1788612581.879281:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260992 00000100:00100000:2.0:1788612581.879283:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260992 00000100:00100000:2.0:1788612581.879293:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932261504 00000100:00100000:2.0:1788612581.879295:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932261504 00000100:00100000:2.0:1788612581.879307:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788612581.879313:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932260608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879410:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932260608:12345-0@lo:400:kworker.0 Request processed in 97us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879417:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788612581.879430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788612581.879436:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932260352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879463:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932260352:12345-0@lo:400:kworker.0 Request processed in 27us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879469:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788612581.879504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788612581.879510:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932260864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879549:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932260864:12345-0@lo:400:kworker.0 Request processed in 40us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879556:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788612581.879567:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788612581.879573:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932261376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879596:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932261376:12345-0@lo:400:kworker.0 Request processed in 24us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879602:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788612581.879611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788612581.879617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932260992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879641:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932260992:12345-0@lo:400:kworker.0 Request processed in 24us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879647:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788612581.879657:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788612581.879662:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932261504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.879701:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932261504:12345-0@lo:400:kworker.0 Request processed in 39us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.879707:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00080000:3.0:1788612581.880454:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1c700 x1875495932261504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612581.880469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932261504:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.880502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932260352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.880522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932260864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.880533:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932261376:0@lo:400:kworker.0 00010000:00080000:3.0:1788612581.880562:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6a1c380 x1875495932260992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612581.880571:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932260992:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.880609:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932260480 00000100:00100000:3.0:1788612581.880615:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932260480 00000100:00100000:3.0:1788612581.880647:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788612581.880654:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932260480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.880715:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932260480:12345-0@lo:400:kworker.0 Request processed in 61us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612581.880722:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788612581.880764:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612581.880769:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612581.880779:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612581.880810:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932260608:0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.882225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932260480:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.883625:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932261120:0@lo:400:kworker.0 00000100:00100000:3.0:1788612581.883642:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932261248:0@lo:400:kworker.0 00000100:00100000:2.0:1788612581.884946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612581.886304:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341376 00000100:00100000:3.0:1788612581.886316:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341376 00000100:00100000:3.0:1788612581.886379:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1788612581.886389:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:11117:x1875495914341376:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:3.0:1788612581.886411:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612581.886434:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22149 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.886527:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc8339 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.886545:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc8339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.886556:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc8339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612581.886813:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788612581.886818:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612581.886853:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc8339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.886876:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22149 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.886905:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc8339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22149 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.886913:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:3.0:1788612581.886916:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612581.886920:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4200, rc 0) 00000100:00100000:3.0:1788612581.886987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:11117:x1875495914341376:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 599us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612581.886995:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1788612581.943408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612581.943564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341504 00000100:00100000:0.0:1788612581.943574:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341504 00000100:00100000:0.0:1788612581.943634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1788612581.943644:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:11123:x1875495914341504:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612581.943676:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612581.943705:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22150 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943773:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943786:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943797:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943808:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943815:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943822:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.943895:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.944413:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.944423:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612581.944463:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788612581.944497:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612581.944999:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945015:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945022:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945029:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945034:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612581.945038:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945046:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945058:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:0.0:1788612581.945061:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612581.945065:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945070:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925800/0x1f8616bf0bc8347 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945084:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945089:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945105:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945111:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe924600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612581.945113:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945120:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945129:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9612c8ef5800) 00010000:00010000:0.0:1788612581.945131:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612581.945135:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945140:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924600/0x1f8616bf0bc834e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945174:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe925c00/0x1f8616bf0bc8340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22150 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945188:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22150 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.945194:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612581.945196:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788612581.945198:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612fe924e00, rc 0) 00000100:00100000:0.0:1788612581.945346:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:11123:x1875495914341504:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1696us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612581.945363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1788612581.952876:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612581.952938:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341760 00000100:00100000:0.0:1788612581.952948:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341760 00000100:00100000:0.0:1788612581.953020:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1788612581.953029:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:11123:x1875495914341760:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612581.953050:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612581.953251:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc835c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22157 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.953414:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.953430:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.953441:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.953525:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.953534:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.953540:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612581.954021:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788612581.954929:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.954951:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.954960:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.954995:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955004:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955010:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955017:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612581.955023:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955031:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955044:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612581.955047:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612581.955052:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955059:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8363 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612581.955255:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d3b3773 reply state 00000000c0892d21 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955275:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955331:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:0.0:1788612581.955335:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612581.955396:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788612581.955431:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc835c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955448:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.955455:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612581.955458:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612581.955460:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612581.955559:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:11123:x1875495914341760:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2529us (2690us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788612581.955568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:3.0:1788612581.959104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612581.959467:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341888 00000100:00100000:2.0:1788612581.959509:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341888 00000100:00100000:2.0:1788612581.959637:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1788612581.959659:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875495914341888:12345-192.168.203.30@tcp:8:bash.0 00010000:00080000:2.0:1788612581.959695:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:2.0:1788612581.959728:0:8440:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc837f 00002000:00100000:2.0:1788612581.959739:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e1800c7e-b9d8-4080-b6d8-c71cdf3d497c/ffff9611c7b91000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788612581.959749:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1788612581.959826:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788612581.959855:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9611c7b91800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612581.959926:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914341888:12345-192.168.203.30@tcp:8:bash.0 Request processed in 267us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612581.959933:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:1.0:1788612581.961770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612581.961952:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342016 00000100:00100000:3.0:1788612581.961962:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342016 00000100:00100000:3.0:1788612581.962036:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:3.0:1788612581.962047:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914342016:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612581.962063:0:8543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612581.962097:0:8543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2215e expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612581.962121:0:8543:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612581.962137:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1788612581.962142:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612581.962153:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 7 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.962192:0:8543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 7 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.962207:0:8543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5e00, rc 0) 00000100:00100000:3.0:1788612581.962264:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:0:x1875495914342016:12345-192.168.203.30@tcp:101:bash.0 Request processed in 219us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612581.962271:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00080000:0.0:1788612581.962427:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612581.971065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612581.971433:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342144 00000100:00100000:3.0:1788612581.971444:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342144 00000100:00100000:3.0:1788612581.971546:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1788612581.971557:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11123:x1875495914342144:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612581.971573:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612581.971591:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22165 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.971622:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 8 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.971631:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612581.971635:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612581.971640:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.971674:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 8 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.971706:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 8 pid: 8543 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612581.971721:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875495932261632:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612581.973897:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612581.980349:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612581.980959:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342272 00000100:00100000:0.0:1788612581.980969:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342272 00010000:00010000:0.0:1788612581.981011:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 9 pid: 8543 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612581.981055:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1788612581.981065:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9284450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914342272:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612581.981104:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612581.981127:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 9 pid: 8543 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.981142:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 9 pid: 8543 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.981166:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612581.981170:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612581.981180:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.981190:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612581.981226:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612581.981241:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1875495932261760:192.168.203.30@tcp:105: 00000100:00100000:0.0:1788612581.981346:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7956e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788612581.982696:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b4bfc3/0x1f8616bf0bc8386 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2215e expref: 9 pid: 8543 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612581.982727:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875495932261632:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612581.982753:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612581.982766:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4e00, rc 0) 00000100:00100000:3.0:1788612581.982830:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:11123:x1875495914342144:12345-192.168.203.30@tcp:101:bash.0 Request processed in 11274us (11773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612581.982985:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1788612581.996141:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1875495932261760:192.168.203.30@tcp:105: 00010000:00010000:0.0:1788612581.996166:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612581.996224:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9284450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914342272:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 15160us (15892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612581.996235:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1788612582.000765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.000966:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342528 00000100:00100000:3.0:1788612582.000975:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342528 00000100:00100000:3.0:1788612582.001028:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612582.001037:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:11123:x1875495914342528:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1788612582.001583:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11123:x1875495914342528:12345-192.168.203.30@tcp:35:bash.0 Request processed in 544us (883us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788612582.001591:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1788612582.089788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612582.089892:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342784 00000100:00100000:0.0:1788612582.089903:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342784 00000100:00100000:0.0:1788612582.089972:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1788612582.089985:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11133:x1875495914342784:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612582.090010:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612582.090032:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2216c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612582.090123:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788612582.090229:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8394 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2216c expref: 18 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.090244:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:0.0:1788612582.090247:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612582.090253:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2216c expref: 18 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.090269:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897e00, rc 0) 00000100:00100000:0.0:1788612582.090336:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:11133:x1875495914342784:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 353us (557us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788612582.090343:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1788612582.094644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612582.094845:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343040 00000100:00100000:2.0:1788612582.094855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343040 00000100:00100000:2.0:1788612582.094912:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612582.094922:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:11133:x1875495914343040:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612582.095140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11133:x1875495914343040:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 219us (507us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788612582.095147:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612582.178372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612582.178524:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343168 00000100:00100000:0.0:1788612582.178535:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343168 00000100:00100000:0.0:1788612582.178592:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1788612582.178602:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11139:x1875495914343168:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612582.178651:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612582.178672:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc83a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22173 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.178737:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc83a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.178760:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.178772:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612582.178824:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788612582.178828:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612582.178847:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.178874:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc83a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22173 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.178893:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc83a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22173 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.178900:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612582.178903:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612582.178906:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896c00, rc 0) 00000100:00100000:0.0:1788612582.179013:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11139:x1875495914343168:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 412us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612582.179020:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1788612582.189840:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.189961:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343424 00000100:00100000:3.0:1788612582.189972:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343424 00000100:00100000:3.0:1788612582.190043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612582.190055:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11139:x1875495914343424:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612582.190085:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612582.190108:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc83b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2217a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.190242:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc83b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.190256:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc83b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.190268:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc83b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612582.190278:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788612582.190398:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc83b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2217a expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.190419:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc83b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2217a expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.190428:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:3.0:1788612582.190431:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612582.190434:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3600, rc 0) 00000100:00100000:3.0:1788612582.190551:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:11139:x1875495914343424:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 498us (720us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788612582.190576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612582.194001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612582.194181:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343552 00000100:00100000:0.0:1788612582.194191:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343552 00000100:00100000:0.0:1788612582.194261:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612582.194272:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:2394:x1875495914343552:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612582.194288:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612582.194314:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc83b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2217a expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.194334:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612582.194338:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612582.194399:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:2394:x1875495914343552:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 129us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612582.194407:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1788612582.201367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612582.201469:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343808 00000100:00100000:1.0:1788612582.201500:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343808 00000100:00100000:1.0:1788612582.201580:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1788612582.201592:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:11139:x1875495914343808:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612582.201638:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612582.201669:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22181 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.202050:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc83cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.202066:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc83cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.202088:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc83cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612582.202101:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788612582.202345:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22181 expref: 23 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.202364:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc83cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22181 expref: 22 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.202372:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:1.0:1788612582.202375:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788612582.202378:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ba00, rc 0) 00000100:00100000:1.0:1788612582.202545:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11139:x1875495914343808:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 953us (1186us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788612582.202553:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:2.0:1788612582.214618:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.214732:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343936 00000100:00100000:3.0:1788612582.214743:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343936 00000100:00100000:3.0:1788612582.214863:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1788612582.214874:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914343936:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:3.0:1788612582.214933:0:8543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.214954:0:8543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.214962:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612582.214966:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612582.214971:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.215012:0:8543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.215027:0:8543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 7 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.215042:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932261888:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612582.215135:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612582.218625:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932261888:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612582.218656:0:8543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612582.219234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.219326:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344064 00000100:00100000:3.0:1788612582.219333:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344064 00002000:00100000:3.0:1788612582.219377:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9611c7880e00 x1875495914344064/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:228/0 lens 504/0 e 0 to 0 dl 1788612593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612582.219386:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c7880e00 with x1875495914344064 ext(0->12) 00010000:00010000:3.0:1788612582.219394:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 8 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.219408:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 8 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612582.219416:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c7880e00 00000100:00100000:3.0:1788612582.219450:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788612582.219460:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914344064:12345-192.168.203.30@tcp:4:lfs.0 00000001:00100000:2.0:1788612582.222583:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000100:00100000:3.0:1788612582.223191:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914344064:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 3724us (3952us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788612582.223204:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:3.0:1788612582.223216:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9611c7880e00 x1875495914344064/t4294967300(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:228/0 lens 504/448 e 0 to 0 dl 1788612593 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612582.223226:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c7880e00 with x1875495914344064 ext(0->12) 00010000:00010000:3.0:1788612582.223236:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.223265:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612582.223272:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c7880e00 00000100:00100000:0.0:1788612582.225841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.226076:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344192 00000100:00100000:3.0:1788612582.226086:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344192 00010000:00010000:3.0:1788612582.226139:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.226232:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612582.226243:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914344192:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612582.226257:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788612582.226276:0:10342:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788612582.226279:0:10342:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788612581 00002000:00010000:3.0:1788612582.226281:0:10342:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788612582 00002000:00010000:3.0:1788612582.226283:0:10342:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788612581 00002000:00010000:3.0:1788612582.226285:0:10342:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788612582.226292:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.226305:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.226342:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4eaab54/0x1f8616bf0bc838d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22165 expref: 9 pid: 8441 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.226376:0:10342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612582.226381:0:10342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612582.226386:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.226396:0:10342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.226430:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612582.226521:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914344192:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 236us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.226529:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00010000:00010000:0.0:1788612582.226811:0:8543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.226825:0:8543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228132:0:8543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228147:0:8543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228173:0:8543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228180:0:8543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612582.228185:0:8543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228195:0:8543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228211:0:8543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.228219:0:8543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2ef306/0x1f8616bf0bc83da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612582.228319:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914343936:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 13444us (13707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612582.228329:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1788612582.230594:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.230835:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344448 00000100:00100000:3.0:1788612582.230845:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344448 00000100:00100000:3.0:1788612582.230913:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788612582.230924:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11139:x1875495914344448:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:3.0:1788612582.230984:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc83cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22181 expref: 22 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612582.231202:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788612582.231252:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788612582.231755:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788612582.231791:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.231806:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.231823:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.231857:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.231877:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 26 pid: 6524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.231892:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1875495932262016:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612582.231980:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612582.234989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612582.235261:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344576 00000100:00100000:0.0:1788612582.235270:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344576 00010000:00010000:0.0:1788612582.235419:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 27 pid: 6524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612582.235470:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1788612582.235525:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:2395:x1875495914344576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612582.235541:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612582.235549:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 27 pid: 6524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.235563:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 27 pid: 6524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.235585:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612582.235590:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.235599:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.235608:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.235627:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612582.235730:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:2395:x1875495914344576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 217us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612582.235750:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00010000:00010000:3.0:1788612582.236647:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8371 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22157 expref: 26 pid: 6524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.236667:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1875495932262016:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612582.236689:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.236696:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.236700:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612582.236784:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788612582.236861:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788612582.236938:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932262144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788612582.236990:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612582.237018:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612582.237130:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932262144 00000100:00100000:0.0:1788612582.237137:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932262144 00000100:00100000:0.0:1788612582.237185:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788612582.237194:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875495932262144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788612582.237697:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875495932262144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 502us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612582.237717:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788612582.238017:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932262144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788612582.238292:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788612582.238518:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6a1c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932262272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788612582.238568:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612582.238595:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612582.238925:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932262272 00000100:00100000:0.0:1788612582.238932:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932262272 00000100:00100000:0.0:1788612582.238973:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788612582.238982:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875495932262272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788612582.239127:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6527:x1875495932262272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 145us (558us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788612582.239136:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788612582.239239:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6a1c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932262272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788612582.239282:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788612582.239320:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.239330:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.239337:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.239343:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612582.239348:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.239356:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.239372:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:1.0:1788612582.239437:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788612582.239442:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.239449:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc83e1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612582.239737:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788612582.239797:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788612582.239820:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396623343058ns, next at 397623341398ns, rc = 0 00000001:00080000:1.0:1788612582.239827:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788612582.239851:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:1.0:1788612582.239853:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788612582.239860:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc83cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22181 expref: 30 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612582.239951:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:11139:x1875495914344448:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 9029us (9366us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788612582.239963:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000020:00080000:1.0:1788612582.239967:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788612582.242856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.242905:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344704 00000100:00100000:3.0:1788612582.242916:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344704 00000100:00100000:3.0:1788612582.242975:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1788612582.242986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:11139:x1875495914344704:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612582.243014:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612582.243092:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc83e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22188 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.243148:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc83e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22188 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.243162:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc83e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22188 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.243222:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612582.243226:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612582.243229:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2400, rc 0) 00000100:00100000:3.0:1788612582.243287:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11139:x1875495914344704:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 303us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.243295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1788612582.252542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612582.252621:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344960 00000100:00100000:2.0:1788612582.252632:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344960 00000100:00100000:2.0:1788612582.252725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788612582.252736:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11139:x1875495914344960:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612582.253162:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:11139:x1875495914344960:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 426us (626us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788612582.253170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788612582.356156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612582.358060:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345216 00000100:00100000:0.0:1788612582.358076:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345216 00000100:00100000:0.0:1788612582.358152:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1788612582.358163:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:11149:x1875495914345216:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612582.358187:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612582.358210:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc83ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2218f expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612582.358305:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788612582.358418:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc83ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2218f expref: 33 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.358433:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:0.0:1788612582.358436:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612582.358441:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc83ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2218f expref: 33 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.358457:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897400, rc 0) 00000100:00100000:0.0:1788612582.358606:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11149:x1875495914345216:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 444us (2459us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788612582.358614:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1788612582.364180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612582.364293:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345344 00000100:00100000:1.0:1788612582.364304:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345344 00000100:00100000:1.0:1788612582.364451:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1788612582.364462:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11149:x1875495914345344:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1788612582.364567:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364586:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364599:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364609:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364626:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364632:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364721:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364730:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364737:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612582.364783:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364796:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364802:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364809:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364815:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612582.364819:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364826:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.364840:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612582.364843:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612582.365606:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366568:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc83fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366587:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366594:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366601:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366607:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612582.366611:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366619:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366637:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:1.0:1788612582.366650:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612582.366655:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366661:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8404 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366672:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366678:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366690:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366695:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612582.366697:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366703:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366710:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:1.0:1788612582.366713:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612582.366716:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.366722:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc840b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612582.367056:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11149:x1875495914345344:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 2591us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612582.367066:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1788612582.370218:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.370441:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345600 00000100:00100000:3.0:1788612582.370449:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345600 00000100:00100000:3.0:1788612582.370769:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1788612582.370792:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11149:x1875495914345600:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612582.371155:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:11149:x1875495914345600:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 375us (947us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788612582.371169:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1788612582.383718:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612582.383749:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932262400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612582.383821:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612582.384104:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932262400 00000100:00100000:1.0:1788612582.384119:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932262400 00000100:00100000:1.0:1788612582.384182:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788612582.384192:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932262400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612582.384228:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612582.384338:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932262656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612582.384372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612582.384412:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932262656 00000100:00100000:2.0:1788612582.384416:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932262656 00000100:00100000:2.0:1788612582.384447:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788612582.384453:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932262656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612582.384472:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612582.384539:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932262656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.384815:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932262528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612582.384845:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612582.384895:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788612582.384916:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932262528 00000100:00100000:2.0:1788612582.384919:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932262528 00000100:00100000:2.0:1788612582.384935:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788612582.384942:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932262528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612582.384953:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612582.385661:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932262400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1468us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.385663:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932262400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612582.385691:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788612582.386326:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932262528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1381us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612582.386347:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788612582.386848:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932262656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612582.391684:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932262528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612582.444815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612582.444916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345856 00000100:00100000:0.0:1788612582.444926:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345856 00000100:00100000:0.0:1788612582.445067:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612582.445079:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:11152:x1875495914345856:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612582.445103:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612582.445237:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8412 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22196 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445301:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445519:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445533:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445547:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445554:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445560:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445663:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445685:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445693:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612582.445703:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788612582.445775:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445782:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445788:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445793:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612582.445796:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445803:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445815:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612582.445817:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612582.445822:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445828:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8419 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445839:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445850:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445856:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445860:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612582.445862:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445868:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445874:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:0.0:1788612582.445877:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612582.445879:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445885:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8420 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445919:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445932:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.445939:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:0.0:1788612582.445941:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612582.445949:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897000, rc 0) 00000100:00100000:0.0:1788612582.446094:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11152:x1875495914345856:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1016us (1286us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788612582.446102:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612582.451088:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.451351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345984 00000100:00100000:3.0:1788612582.451361:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345984 00000100:00100000:3.0:1788612582.451584:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1788612582.451595:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11152:x1875495914345984:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1788612582.451664:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451683:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451695:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451729:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451735:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451758:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451764:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612582.451768:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451782:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451794:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612582.451797:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612582.451882:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.451890:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8435 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.451971:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11152:x1875495914345984:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 377us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.451979:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1788612582.455809:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612582.455883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346240 00000100:00100000:2.0:1788612582.455893:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346240 00000100:00100000:2.0:1788612582.455951:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788612582.455960:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11152:x1875495914346240:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612582.456180:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+36:11152:x1875495914346240:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 221us (376us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788612582.456188:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00010000:00010000:3.0:1788612582.767660:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612582.787017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612582.789580:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346496 00000100:00100000:1.0:1788612582.789593:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346496 00000100:00100000:1.0:1788612582.789665:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1788612582.789674:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+36:11182:x1875495914346496:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1788612582.789695:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612582.789715:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc843c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2219d expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.789809:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc8443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.789823:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc8443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.789834:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc8443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612582.789844:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788612582.789952:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc843c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2219d expref: 39 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.789971:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc8443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2219d expref: 38 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.789980:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:1.0:1788612582.789983:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612582.789999:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a200, rc 0) 00000100:00100000:1.0:1788612582.790068:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11182:x1875495914346496:12345-192.168.203.30@tcp:101:cat.0 Request processed in 394us (3059us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788612582.790076:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1788612582.793315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.793414:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346752 00000100:00100000:3.0:1788612582.793424:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346752 00000100:00100000:3.0:1788612582.793551:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788612582.793565:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11182:x1875495914346752:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1788612582.793966:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:11182:x1875495914346752:12345-192.168.203.30@tcp:35:cat.0 Request processed in 402us (657us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788612582.793986:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1788612582.794099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.794254:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346880 00000100:00100000:3.0:1788612582.794259:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346880 00000100:00100000:3.0:1788612582.794303:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788612582.794310:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:2394:x1875495914346880:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612582.794320:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612582.794708:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc8443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2219d expref: 39 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.794727:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612582.794732:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612582.794805:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:2394:x1875495914346880:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 495us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.794813:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612582.874212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.874639:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347136 00000100:00100000:3.0:1788612582.874649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347136 00000100:00100000:3.0:1788612582.874711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612582.874720:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11189:x1875495914347136:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788612582.874743:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612582.874746:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788612582.874772:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc83a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22173 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.876294:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612582.876301:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612582.876334:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8451 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221a4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.876468:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.877915:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.877929:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.877977:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.877994:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 38 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.878011:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932262784:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612582.878131:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612582.883148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612582.883446:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347264 00000100:00100000:1.0:1788612582.883455:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347264 00010000:00010000:1.0:1788612582.883543:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 39 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612582.883578:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1788612582.883589:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:2395:x1875495914347264:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612582.883605:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612582.883614:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 39 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.883628:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 39 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.883655:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:1.0:1788612582.883660:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.883670:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.883678:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612582.883698:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612582.883767:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:2395:x1875495914347264:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 180us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612582.883775:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00010000:00010000:3.0:1788612582.884055:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8427 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22196 expref: 38 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612582.884071:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932262784:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612582.884090:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.884099:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.884114:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612582.884130:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788612582.884266:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8451 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.884899:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.884908:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612582.884911:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612582.884914:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2800, rc 0) 00000100:00100000:3.0:1788612582.884954:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11189:x1875495914347136:12345-192.168.203.30@tcp:101:dd.0 Request processed in 10235us (10752us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788612582.884961:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:0.0:1788612582.890952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.891031:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347392 00000100:00100000:3.0:1788612582.891041:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347392 00000100:00100000:3.0:1788612582.891109:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1788612582.891120:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11189:x1875495914347392:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788612582.891147:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612582.891170:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc8466 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221ab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.891207:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.891241:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.891253:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.896059:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc8466 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.896089:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.896099:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612582.896102:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612582.896105:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4e00, rc 0) 00000100:00100000:3.0:1788612582.896186:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:11189:x1875495914347392:12345-192.168.203.30@tcp:101:dd.0 Request processed in 5066us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612582.896194:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1788612582.906579:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612582.907135:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347648 00000100:00100000:3.0:1788612582.907147:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347648 00000100:00100000:3.0:1788612582.907213:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1788612582.907224:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:11189:x1875495914347648:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1788612582.907464:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.907500:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.907550:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612582.907606:0:12327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788612582.907631:0:12327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f5717e9 reply state 00000000ab974d18 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.907642:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612582.907650:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612582.907652:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612582.907657:0:12327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612582.907756:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:11189:x1875495914347648:12345-192.168.203.30@tcp:36:dd.0 Request processed in 534us (1186us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788612582.907765:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000020:00080000:3.0:1788612582.907770:0:12327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788612583.152635:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788612583.153773:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788612583.254553:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612583.255539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347776 00000100:00100000:3.0:1788612583.255550:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347776 00000100:00100000:3.0:1788612583.255614:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1788612583.255625:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:11204:x1875495914347776:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1788612583.255647:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612583.255667:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc847b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221b2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.255724:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.255756:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.255768:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.255790:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.255797:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.255804:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788612583.256126:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612583.257007:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.257026:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.257035:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.257079:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.257096:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 43 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612583.257126:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932262912:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612583.257235:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612583.263942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612583.264030:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348032 00000100:00100000:1.0:1788612583.264039:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348032 00000100:00100000:1.0:1788612583.264113:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1788612583.264125:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:6164:x1875495914348032:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788612583.264896:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+45:6164:x1875495914348032:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 768us (959us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788612583.264906:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1788612583.266038:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedbb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932262912:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612583.266069:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612583.267672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612583.270093:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348160 00000100:00100000:1.0:1788612583.270109:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348160 00010000:00010000:1.0:1788612583.270242:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 45 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612583.270306:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1788612583.270317:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+45:2394:x1875495914348160:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612583.270334:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612583.270343:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 45 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.270407:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 45 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.270430:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bc8458 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221a4 expref: 45 pid: 6524 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.270466:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:1.0:1788612583.270472:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.270647:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.270654:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.270697:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612583.270766:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:2394:x1875495914348160:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 450us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612583.270774:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00010000:00010000:0.0:1788612583.271266:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271276:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612583.271329:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788612583.271334:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612583.271386:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271399:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271408:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271427:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271433:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271439:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612583.271444:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271452:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271463:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612583.271466:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612583.271470:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271496:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2200/0x1f8616bf0bc8482 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271520:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271527:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271541:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271546:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612583.271555:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271562:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271571:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:0.0:1788612583.271573:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612583.271576:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271582:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8489 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271616:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3600/0x1f8616bf0bc847b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b2 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271630:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b2 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.271638:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:0.0:1788612583.271640:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612583.271643:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:0.0:1788612583.271678:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:11204:x1875495914347776:12345-192.168.203.30@tcp:101:stat.0 Request processed in 16056us (17134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612583.271685:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:1.0:1788612583.355619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612583.355705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348416 00000100:00100000:3.0:1788612583.355715:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348416 00000100:00100000:3.0:1788612583.355778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612583.355796:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:11210:x1875495914348416:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:3.0:1788612583.355854:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612583.355883:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8490 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b2 expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.355903:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612583.355908:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612583.356087:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.356103:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.356114:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612583.356158:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788612583.356180:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad84236d reply state 00000000dc2d81e0 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.356208:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.356215:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612583.356217:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612583.356221:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612583.356335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+45:11210:x1875495914348416:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 543us (725us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788612583.356342:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000020:00080000:3.0:1788612583.356347:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788612583.620985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612583.623559:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348544 00000100:00100000:0.0:1788612583.623573:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348544 00000100:00100000:0.0:1788612583.623686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788612583.623696:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+45:11224:x1875495914348544:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:0.0:1788612583.623731:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612583.623752:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc849e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221b9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623824:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623839:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623850:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623861:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623867:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623873:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623945:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623954:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.623960:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612583.623995:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788612583.624004:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612583.624025:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624036:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624044:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624050:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624056:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624060:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612583.624064:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624071:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624081:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612583.624084:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612583.624088:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624094:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624106:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624122:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624127:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624131:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612583.624134:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624140:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624148:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:0.0:1788612583.624150:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612583.624153:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624159:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc84ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624185:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc849e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 47 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624197:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 46 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.624203:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:0.0:1788612583.624205:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612583.624213:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896c00, rc 0) 00000100:00100000:0.0:1788612583.624288:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+46:11224:x1875495914348544:12345-192.168.203.30@tcp:101:stat.0 Request processed in 593us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612583.624296:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788612583.726856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612583.727051:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348800 00000100:00100000:3.0:1788612583.727062:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348800 00000100:00100000:3.0:1788612583.727126:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1788612583.727138:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+46:11234:x1875495914348800:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612583.727161:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612583.727185:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc84ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221c0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612583.727286:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788612583.727386:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc84ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c0 expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.727401:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:3.0:1788612583.727403:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612583.727408:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc84ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c0 expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.727436:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:3.0:1788612583.727558:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:11234:x1875495914348800:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 422us (710us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788612583.727566:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1788612583.732030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612583.732967:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349056 00000100:00100000:1.0:1788612583.732980:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349056 00000100:00100000:1.0:1788612583.733055:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1788612583.733066:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:11234:x1875495914349056:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788612583.733310:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+48:11234:x1875495914349056:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 245us (1287us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788612583.733318:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00010000:00010000:1.0:1788612583.794702:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612583.838986:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612583.839585:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349312 00000100:00100000:2.0:1788612583.839596:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349312 00000100:00100000:2.0:1788612583.839660:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:2.0:1788612583.839670:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+48:11240:x1875495914349312:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612583.839695:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612583.839716:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc84c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221c7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.839846:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.839863:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 49 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.839893:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.839932:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 49 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.839945:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 49 pid: 6525 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612583.839960:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932263040:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612583.840080:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612583.842909:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932263040:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612583.842942:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612583.843223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612583.843711:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349440 00000100:00100000:3.0:1788612583.843721:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349440 00010000:00010000:3.0:1788612583.843761:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 50 pid: 6525 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612583.843810:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1788612583.843820:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9284c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+50:2394:x1875495914349440:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612583.843836:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612583.843843:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 50 pid: 6525 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.843857:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 50 pid: 6525 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.843881:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc84b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221b9 expref: 50 pid: 6525 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.844015:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612583.844021:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.844031:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.844056:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.844089:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612583.844320:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9284c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+49:2394:x1875495914349440:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 492us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612583.844329:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00010000:00010000:2.0:1788612583.845968:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.845984:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612583.846008:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788612583.846172:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc84c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 50 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.846194:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 49 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612583.846223:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:2.0:1788612583.846226:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612583.846230:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36a00, rc 0) 00000100:00100000:2.0:1788612583.846282:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+49:11240:x1875495914349312:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6612us (7305us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788612583.846290:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788612583.854178:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612583.855276:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349696 00000100:00100000:0.0:1788612583.855288:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349696 00000100:00100000:0.0:1788612583.855373:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1788612583.855383:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+49:11240:x1875495914349696:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:1.0:1788612583.856945:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.856988:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.857000:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612583.857063:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788612583.857101:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e82e7d2d reply state 000000002eecb8ee transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.857114:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612583.857122:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:1.0:1788612583.857125:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612583.857129:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612583.857268:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+52:11240:x1875495914349696:12345-192.168.203.30@tcp:36:bash.0 Request processed in 1883us (3097us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788612583.857278:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000020:00080000:1.0:1788612583.857284:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788612583.864242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612583.864526:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349824 00000100:00100000:3.0:1788612583.864535:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349824 00000100:00100000:3.0:1788612583.864584:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1788612583.864592:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+52:11240:x1875495914349824:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612583.865598:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612583.865624:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc84e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221ce expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.865715:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.865733:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 53 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.866005:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.866056:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 53 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.866093:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 53 pid: 12327 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612583.866107:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932263168:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612583.866581:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612583.878726:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fedb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932263168:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612583.878759:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612583.879293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612583.879540:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349952 00000100:00100000:0.0:1788612583.879548:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349952 00010000:00010000:0.0:1788612583.879588:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 54 pid: 12327 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612583.879676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1788612583.879687:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:2395:x1875495914349952:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612583.879699:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612583.879706:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 54 pid: 12327 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.879719:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 54 pid: 12327 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.879742:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc84cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221c7 expref: 54 pid: 12327 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.879757:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:0.0:1788612583.879786:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.879797:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.879805:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.879837:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612583.879908:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:2395:x1875495914349952:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 222us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612583.879916:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00010000:00010000:3.0:1788612583.886567:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.886584:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612583.886641:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788612583.886645:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612583.886666:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.886705:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc84e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ce expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.886724:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ce expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612583.886734:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612583.886752:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612583.886757:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241c00, rc 0) 00000100:00100000:3.0:1788612583.886849:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+52:11240:x1875495914349824:12345-192.168.203.30@tcp:101:bash.0 Request processed in 22256us (22614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612583.886857:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1788612583.891849:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612583.891916:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350208 00000100:00100000:3.0:1788612583.891925:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350208 00000100:00100000:3.0:1788612583.891972:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:3.0:1788612583.891981:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+52:11240:x1875495914350208:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1788612583.892197:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:11240:x1875495914350208:12345-192.168.203.30@tcp:35:bash.0 Request processed in 217us (358us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788612583.892204:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612583.986765:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612583.986871:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350464 00000100:00100000:0.0:1788612583.986883:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350464 00000100:00100000:0.0:1788612583.986955:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:0.0:1788612583.986965:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:11250:x1875495914350464:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612583.986987:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612583.987008:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221d5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612583.987097:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788612583.987194:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221d5 expref: 55 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.987208:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:0.0:1788612583.987211:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612583.987217:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc84f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221d5 expref: 55 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612583.987248:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897a00, rc 0) 00000100:00100000:0.0:1788612583.987309:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11250:x1875495914350464:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 345us (553us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788612583.987316:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1788612584.002150:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.002244:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350592 00000100:00100000:3.0:1788612584.002255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350592 00000100:00100000:3.0:1788612584.002372:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:3.0:1788612584.002382:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11250:x1875495914350592:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788612584.002459:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002526:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002539:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002553:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002580:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002588:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002665:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002675:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002681:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612584.002730:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002742:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002749:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002757:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002762:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.002767:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002775:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002795:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612584.002799:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.002805:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002812:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8500 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002825:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002832:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002837:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002842:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.002844:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002850:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002856:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:3.0:1788612584.002859:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.002862:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002867:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8507 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002902:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002909:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002914:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002919:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.002922:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002927:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002944:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.002947:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.002951:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.002956:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc850e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612584.003239:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11250:x1875495914350592:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 857us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612584.003248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:0.0:1788612584.007375:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.007540:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350848 00000100:00100000:3.0:1788612584.007550:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350848 00000100:00100000:3.0:1788612584.007612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1788612584.007635:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11250:x1875495914350848:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612584.007842:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:11250:x1875495914350848:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 208us (475us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788612584.007851:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1788612584.080806:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.080967:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351104 00000100:00100000:3.0:1788612584.080976:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351104 00000100:00100000:3.0:1788612584.081040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1788612584.081051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:11253:x1875495914351104:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612584.081073:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612584.081094:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8515 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221dc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081172:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081187:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081199:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081210:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081218:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081224:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081352:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc852a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081362:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc852a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081369:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc852a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612584.081378:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788612584.081445:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081452:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081458:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081463:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.081467:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081525:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081537:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612584.081540:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.081545:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081551:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc851c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081570:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081574:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081579:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081584:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.081586:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081592:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081599:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:3.0:1788612584.081601:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.081605:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081609:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081642:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8515 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221dc expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081653:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc852a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221dc expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.081670:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.081672:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612584.081674:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241600, rc 0) 00000100:00100000:3.0:1788612584.081733:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+57:11253:x1875495914351104:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 684us (936us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788612584.081740:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:1.0:1788612584.089696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.089785:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351232 00000100:00100000:3.0:1788612584.089795:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351232 00000100:00100000:3.0:1788612584.089853:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1788612584.089863:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+57:11253:x1875495914351232:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1788612584.089945:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.089962:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.089975:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090008:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090015:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090021:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090027:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.090043:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090051:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090063:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.090066:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612584.090070:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.090076:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8538 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612584.090149:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+57:11253:x1875495914351232:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 287us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612584.090156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:1.0:1788612584.093532:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612584.093569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612584.093656:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351488 00000100:00100000:2.0:1788612584.093665:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351488 00000100:00100000:2.0:1788612584.093711:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1788612584.093721:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+57:11253:x1875495914351488:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612584.093953:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11253:x1875495914351488:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 233us (382us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788612584.093961:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1788612584.094078:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351616 00000100:00100000:3.0:1788612584.094083:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351616 00000100:00100000:3.0:1788612584.094125:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612584.094133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:2397:x1875495914351616:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612584.094152:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612584.094174:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc852a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221dc expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.094191:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.094196:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612584.094217:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+57:2397:x1875495914351616:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 85us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612584.094239:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1788612584.309987:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.310117:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351872 00000100:00100000:3.0:1788612584.310127:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351872 00000100:00100000:3.0:1788612584.310191:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1788612584.310201:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+57:11271:x1875495914351872:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1788612584.310224:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612584.310247:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc853f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221e3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.310369:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8546 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.310385:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.310396:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612584.310406:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788612584.310546:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc853f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221e3 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.310565:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221e3 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.310573:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.310576:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788612584.310580:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240600, rc 0) 00000100:00100000:3.0:1788612584.310656:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:11271:x1875495914351872:12345-192.168.203.30@tcp:101:cat.0 Request processed in 456us (678us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788612584.310664:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:1.0:1788612584.338159:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612584.338231:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352000 00000100:00100000:0.0:1788612584.338239:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352000 00000100:00100000:0.0:1788612584.338287:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:0.0:1788612584.338295:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:11272:x1875495914352000:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612584.338320:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612584.338338:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc8554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221ea expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.338391:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc855b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.338403:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc855b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.338411:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc855b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612584.338449:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788612584.338452:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612584.338469:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc855b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.338548:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc8554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ea expref: 61 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.338582:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc855b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ea expref: 60 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.338591:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612584.338594:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612584.338597:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896a00, rc 0) 00000100:00100000:0.0:1788612584.338656:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11272:x1875495914352000:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 360us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612584.338663:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1788612584.353212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612584.353322:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352384 00000100:00100000:2.0:1788612584.353332:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352384 00000100:00100000:2.0:1788612584.353396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612584.353406:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11272:x1875495914352384:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612584.353693:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11272:x1875495914352384:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 288us (491us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788612584.353719:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612584.361412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.361537:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352512 00000100:00100000:3.0:1788612584.361547:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352512 00000100:00100000:3.0:1788612584.361612:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612584.361622:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11272:x1875495914352512:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:3.0:1788612584.361636:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788612584.361660:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc84eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ce expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.361682:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221e3 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.361700:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc83e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22188 expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.361710:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.361715:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612584.362928:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11272:x1875495914352512:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 1298us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612584.362941:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1788612584.376227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612584.376708:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352640 00000100:00100000:0.0:1788612584.376718:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352640 00000100:00100000:0.0:1788612584.376822:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1788612584.376834:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11272:x1875495914352640:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:0.0:1788612584.376979:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.376999:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612584.377011:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612584.377267:0:8253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612584.377411:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788612584.377555:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788612584.377646:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11272:x1875495914352640:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 812us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612584.377663:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1788612584.400791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612584.401664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352768 00000100:00100000:3.0:1788612584.401675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352768 00000100:00100000:3.0:1788612584.401741:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:3.0:1788612584.401751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11274:x1875495914352768:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612584.401769:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612584.401801:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8569 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221f1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401877:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401890:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401901:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401910:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401917:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401922:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401989:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.401998:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402005:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612584.402047:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788612584.402051:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612584.402069:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402088:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402097:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402104:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402111:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402116:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.402120:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402129:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402141:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612584.402144:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.402282:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402290:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8570 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402304:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402311:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402326:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402333:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612584.402335:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402341:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402350:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:3.0:1788612584.402353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612584.402356:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402362:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8577 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402391:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8569 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402405:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612584.402411:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612584.402413:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612584.402415:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:3.0:1788612584.402591:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:11274:x1875495914352768:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 840us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612584.402620:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00010000:00010000:3.0:1788612584.815992:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612585.175819:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612585.175828:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612585.175852:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788612585.175858:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788612585.199629:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612585.199637:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612585.199676:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788612585.199683:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788612585.199811:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932263296:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788612585.199921:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fccdbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612585.207234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612585.207270:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352896 00000100:00100000:3.0:1788612585.207278:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352896 00000100:00100000:3.0:1788612585.207349:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1788612585.207360:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11286:x1875495914352896:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612585.207389:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612585.207534:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11286:x1875495914352896:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 175us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612585.207542:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00080000:3.0:1788612585.207564:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612585.210218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.210318:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353024 00000100:00100000:0.0:1788612585.210325:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353024 00000100:00100000:0.0:1788612585.210411:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:0.0:1788612585.210422:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11286:x1875495914353024:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788612585.210520:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210539:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210554:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210570:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210577:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210584:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210623:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210630:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210635:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612585.210670:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788612585.210673:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612585.210683:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210691:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210695:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210700:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210703:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612585.210706:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210711:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210719:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:0.0:1788612585.210726:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612585.210730:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210745:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8585 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210760:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210766:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210772:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210777:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612585.210780:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210786:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210794:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9611c65f7300) 00010000:00010000:0.0:1788612585.210797:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612585.210800:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210806:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc858c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210826:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210840:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210846:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210851:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612585.210854:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210861:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210869:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:0.0:1788612585.210872:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612585.210875:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.210881:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8593 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612585.210957:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11286:x1875495914353024:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 537us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612585.210965:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1788612585.211547:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932263296:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788612585.212721:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612585.212766:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353280 00000100:00100000:3.0:1788612585.212774:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353280 00000100:00100000:3.0:1788612585.212833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:3.0:1788612585.212846:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:11286:x1875495914353280:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612585.212866:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612585.212890:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc859a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221f8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.212995:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213006:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213023:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612585.213033:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788612585.213608:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213618:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213625:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213631:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612585.213635:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213644:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213657:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612585.213660:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612585.213664:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213670:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc85a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213713:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc859a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f8 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213751:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:3.0:1788612585.213754:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612585.213759:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc859a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f8 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.213769:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240600, rc 0) 00000100:00100000:3.0:1788612585.213832:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11286:x1875495914353280:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 988us (1115us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788612585.213840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000001:00080000:1.0:1788612585.214297:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:1.0:1788612585.214350:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788612585.214386:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9611c67ec480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788612585.214390:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fcd72000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9611c67eca80 00000020:00080000:1.0:1788612585.214393:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fcd72200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9612c65b4a00 00000100:00100000:1.0:1788612585.214552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932263424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788612585.214606:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612585.214652:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.214658:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932263424 00010000:00010000:3.0:1788612585.214660:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.214664:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932263424 00010000:00010000:3.0:1788612585.214666:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214672:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00000020:00080000:2.0:1788612585.214674:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:3.0:1788612585.214676:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214686:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214697:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9612c8ef5800) 00010000:00010000:3.0:1788612585.214699:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612585.214702:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.214712:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788612585.214716:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8324 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.214722:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932263424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788612585.214742:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:3.0:1788612585.214753:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214759:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214764:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214769:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc184d4f0) 00002000:00010000:1.0:1788612585.214769:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c0fe5, atime: 0x6a9c0fe6, ctime: 0x6a9c0fe5, blocks: 0x8 00010000:00010000:3.0:1788612585.214772:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214776:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214778:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214788:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612585.214790:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612585.214790:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1788612585.214793:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214794:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612585.214799:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc832b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214800:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214813:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214816:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214819:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214825:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214831:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214833:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214837:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612585.214840:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214846:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214853:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612585.214855:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c65f7200) 00010000:00010000:3.0:1788612585.214857:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612585.214860:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214865:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc836a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214893:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214899:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788612585.214904:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788612585.214905:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214914:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612585.214917:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214942:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214950:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612585.214953:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612585.214956:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214961:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5e00/0x1f8616bf0bc8474 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.214964:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932263424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (357us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788612585.214971:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788612585.214975:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214980:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214986:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214990:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612585.214991:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612585.214993:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.214997:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.214999:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.215005:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612585.215007:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612585.215009:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612585.215009:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215012:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.215017:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215027:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8497 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.215030:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.215037:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05f6600/0x1f8616bf0bc85af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215039:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215045:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215051:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215055:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612585.215055:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612585.215058:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612585.215059:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.215060:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612585.215065:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215073:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612585.215075:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612585.215077:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.215082:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc84dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612585.215088:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961301805f80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788612585.215094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932263424:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788612585.215104:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612585.217729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612585.217763:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353408 00000100:00100000:3.0:1788612585.217771:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353408 00000100:00100000:3.0:1788612585.217830:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:3.0:1788612585.217839:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11286:x1875495914353408:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612585.217878:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612585.217982:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11286:x1875495914353408:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 143us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612585.217990:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:0.0:1788612585.222130:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.222302:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353664 00000100:00100000:1.0:1788612585.222312:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353664 00000100:00100000:1.0:1788612585.222374:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:1.0:1788612585.222383:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11286:x1875495914353664:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612585.222401:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612585.222404:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612585.222428:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc855b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ea expref: 13 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.222446:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612585.222451:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612585.222464:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d221ff expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612585.222929:0:8253:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788612585.223073:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc85bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.223088:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc85bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.223099:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc85bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.223154:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ff expref: 15 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.223169:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc85bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ff expref: 14 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.223233:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b600) 00010000:00010000:1.0:1788612585.223237:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612585.223239:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:1.0:1788612585.223458:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914353664:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1074us (1338us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788612585.223466:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:3.0:1788612585.226054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.226134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353920 00000100:00100000:0.0:1788612585.226142:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353920 00000100:00100000:0.0:1788612585.226192:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1788612585.226206:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914353920:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612585.226268:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612585.226291:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc85bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ff expref: 14 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226312:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b600) 00010000:00010000:0.0:1788612585.226321:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612585.226341:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226354:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226363:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226376:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226384:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226390:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226439:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226447:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226453:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226466:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612585.226471:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226725:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226734:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612585.226737:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612585.226742:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226748:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226759:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226765:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226772:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226776:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612585.226779:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226785:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226803:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x40bf6ff9 (ffff9611c65f7300) 00010000:00010000:0.0:1788612585.226806:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612585.226808:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.226814:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc85d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x40bf6ff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612585.226930:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11286:x1875495914353920:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 728us (884us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612585.226939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:3.0:1788612585.228760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.228823:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354048 00000100:00100000:1.0:1788612585.228833:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354048 00000100:00100000:1.0:1788612585.228884:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788612585.228894:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11286:x1875495914354048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612585.228912:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612585.228934:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc85d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22206 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.228966:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.228976:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.228985:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.229088:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc85d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.229104:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 14 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.229115:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:1.0:1788612585.229117:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612585.229119:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b400, rc 0) 00000100:00100000:1.0:1788612585.229202:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914354048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 310us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612585.229209:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1788612585.233010:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612585.233061:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354304 00000100:00100000:3.0:1788612585.233073:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354304 00000100:00100000:3.0:1788612585.233132:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1788612585.233144:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914354304:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612585.233239:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.233257:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.233270:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612585.233612:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788612585.233623:0:8253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399617146283ns, next at 400617143898ns, rc = 0 00000004:00010000:3.0:1788612585.233675:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2c04590 reply state 00000000287b5754 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.233690:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.233707:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:3.0:1788612585.233710:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788612585.233715:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612585.233812:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11286:x1875495914354304:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 670us (810us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788612585.233821:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:0.0:1788612585.237559:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.237805:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354432 00000100:00100000:1.0:1788612585.237816:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354432 00000100:00100000:1.0:1788612585.237907:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1788612585.237917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11286:x1875495914354432:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612585.237939:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612585.237959:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2220d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.238012:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.238027:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.238045:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:1.0:1788612585.238048:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612585.238057:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a000, rc 0) 00000100:00100000:1.0:1788612585.238105:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:11286:x1875495914354432:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 189us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612585.238123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:0.0:1788612585.242867:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.243298:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354560 00000100:00100000:1.0:1788612585.243308:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354560 00000100:00100000:1.0:1788612585.243350:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1788612585.243359:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875495914354560:12345-192.168.203.30@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788612585.243401:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:1.0:1788612585.243430:0:8439:0:(genops.c:1385:class_connect()) connect: client e1800c7e-b9d8-4080-b6d8-c71cdf3d497c, cookie 0x1f8616bf0bc85f5 00002000:00100000:1.0:1788612585.243439:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e1800c7e-b9d8-4080-b6d8-c71cdf3d497c/ffff9611c80c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612585.243456:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1788612585.243566:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612585.243596:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9611c80c5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612585.243662:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2393:x1875495914354560:12345-192.168.203.30@tcp:8:lhsmtool_posix.0 Request processed in 302us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612585.243670:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1788612585.245947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.246034:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354688 00000100:00100000:1.0:1788612585.246044:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354688 00000100:00080000:2.0:1788612585.246096:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612585.246119:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788612585.246129:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:0:x1875495914354688:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1788612585.254597:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788612585.254614:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000100:00100000:3.0:1788612585.254787:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:0:x1875495914354688:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 8653us (8842us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788612585.254798:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:0.0:1788612585.258999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.260429:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354944 00000100:00100000:2.0:1788612585.260441:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354944 00000100:00100000:2.0:1788612585.260625:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612585.260638:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:11286:x1875495914354944:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788612585.260834:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11286:x1875495914354944:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 198us (1841us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788612585.260842:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612585.263034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.263113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355200 00000100:00100000:2.0:1788612585.263123:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355200 00000100:00100000:2.0:1788612585.263169:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:2.0:1788612585.263180:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11286:x1875495914355200:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788612585.263293:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11286:x1875495914355200:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612585.263301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:3.0:1788612585.266137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.266258:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355328 00000100:00100000:0.0:1788612585.266269:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355328 00000100:00100000:0.0:1788612585.266524:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1788612585.266537:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11286:x1875495914355328:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612585.266556:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612585.266578:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22214 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.266672:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8603 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.266688:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8603 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.266701:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8603 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612585.267689:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612585.267722:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8603 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.267951:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc85fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22214 expref: 20 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.267972:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8603 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22214 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.267982:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:0.0:1788612585.267986:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612585.267990:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897e00, rc 0) 00000100:00100000:0.0:1788612585.268106:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11286:x1875495914355328:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1571us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612585.268114:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1788612585.272032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.272183:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355456 00000100:00100000:2.0:1788612585.272193:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355456 00000100:00100000:2.0:1788612585.272301:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:2.0:1788612585.272319:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914355456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612585.272337:0:8543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612585.272358:0:8543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2221b expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612585.272383:0:8543:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c0fe9, blocks: 0x0 00010000:00010000:2.0:1788612585.272402:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1788612585.272407:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612585.272415:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 6 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.272436:0:8543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 6 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.272450:0:8543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36800, rc 0) 00000100:00100000:2.0:1788612585.272538:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914355456:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 221us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612585.272545:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1788612585.276623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.277896:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355712 00000100:00100000:1.0:1788612585.277908:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355712 00000100:00100000:1.0:1788612585.277981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1788612585.277992:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11286:x1875495914355712:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788612585.278104:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11286:x1875495914355712:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 114us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612585.278130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1788612585.292683:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.293414:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355840 00000100:00100000:0.0:1788612585.293425:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355840 00000100:00100000:1.0:1788612585.294238:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1788612585.294254:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:11286:x1875495914355840:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612585.294273:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612585.294292:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22222 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.294323:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.294332:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612585.294336:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612585.294751:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.294790:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.294804:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.294817:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932263552:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612585.295895:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612585.304744:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932263552:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612585.304781:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.304803:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:3.0:1788612585.304857:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11286:x1875495914355840:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 10607us (12182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612585.304866:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:3.0:1788612585.304945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612585.305011:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355968 00000100:00100000:3.0:1788612585.305018:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355968 00010000:00010000:3.0:1788612585.305064:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.305096:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1788612585.307768:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914355968:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612585.307797:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612585.307825:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.307843:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.307868:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028832891/0x1f8616bf0bc860a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2221b expref: 7 pid: 8543 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.307882:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612585.307886:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612585.307895:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.307905:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.307970:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 6 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.307986:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6adb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875495932263680:192.168.203.30@tcp:105: 00000100:00100000:3.0:1788612585.308073:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612585.325810:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6adb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875495932263680:192.168.203.30@tcp:105: 00010000:00010000:3.0:1788612585.325848:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612585.325898:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914355968:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 20786us (20952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612585.325910:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1788612585.326528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612585.326559:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356096 00000100:00100000:3.0:1788612585.326566:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356096 00002000:00100000:3.0:1788612585.326604:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9611c6adb100 x1875495914356096/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:231/0 lens 504/0 e 0 to 0 dl 1788612596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612585.326615:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6adb100 with x1875495914356096 ext(0->8) 00002000:00010000:3.0:1788612585.326621:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c6adb100 00000100:00100000:3.0:1788612585.326647:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788612585.326656:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914356096:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788612585.328515:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914356096:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 1853us (1982us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788612585.328528:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:3.0:1788612585.328539:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9611c6adb100 x1875495914356096/t4294967303(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:231/0 lens 504/448 e 0 to 0 dl 1788612596 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612585.328549:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6adb100 with x1875495914356096 ext(0->8) 00002000:00010000:3.0:1788612585.328555:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c6adb100 00000100:00100000:3.0:1788612585.333343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.333408:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356224 00000100:00100000:1.0:1788612585.333432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356224 00000100:00100000:1.0:1788612585.333529:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:1.0:1788612585.333541:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11286:x1875495914356224:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788612585.348206:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788612585.348223:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788612585.348238:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788612585.348624:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788612585.348637:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788612585.348646:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612585.348666:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932263808:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788612585.348674:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.348687:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.348703:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.348709:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612585.348715:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.348734:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.348740:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612585.348754:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:3.0:1788612585.348759:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788612585.348764:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.348771:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc85e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612585.352727:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914356224:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 19176us (19381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612585.352755:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:1.0:1788612585.352922:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932263808 00000100:00100000:1.0:1788612585.352930:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932263808 00000100:00100000:1.0:1788612585.352995:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612585.353005:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932263808:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788612585.353015:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788612585.353124:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788612585.353127:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788612585 00002000:00010000:1.0:1788612585.353129:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788612585.353132:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788612585 -> 1788612585 00002000:00010000:1.0:1788612585.353134:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788612585.353365:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932263808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 361us (4628us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788612585.353373:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788612585.353402:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9612d8192680/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788612585.353410:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932263808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788612585.357933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.358108:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356352 00000100:00100000:0.0:1788612585.358119:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356352 00000100:00100000:0.0:1788612585.358180:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1788612585.358191:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914356352:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788612585.361081:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788612585.361095:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788612585.366977:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914356352:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 8776us (9043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612585.366993:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:3.0:1788612585.371627:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.372123:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356608 00000100:00100000:0.0:1788612585.372134:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356608 00000100:00100000:0.0:1788612585.372231:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:0.0:1788612585.372243:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914356608:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612585.372296:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612585.372322:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8603 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22214 expref: 14 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.372340:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:0.0:1788612585.372346:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612585.372373:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.372386:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.372416:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612585.372692:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1aff711 reply state 00000000cf927997 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.372707:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.372714:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:1.0:1788612585.372716:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612585.372719:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612585.372867:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:11286:x1875495914356608:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 625us (1248us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788612585.372896:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:3.0:1788612585.375234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.375470:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356736 00000100:00100000:1.0:1788612585.375626:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356736 00000100:00100000:1.0:1788612585.375684:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:1.0:1788612585.375694:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914356736:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788612585.375853:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788612585.375857:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788612585 -> 1788612583 00002000:00010000:1.0:1788612585.375860:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788612582 00002000:00010000:1.0:1788612585.375862:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788612585 -> 1788612583 00002000:00010000:1.0:1788612585.375864:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788612585.375934:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914356736:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 233us (704us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788612585.375942:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:3.0:1788612585.382297:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.382531:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356992 00000100:00100000:2.0:1788612585.382541:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356992 00000100:00100000:2.0:1788612585.382600:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1788612585.382610:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:11286:x1875495914356992:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788612585.382684:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.382701:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.382710:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.382744:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.382758:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 15 pid: 12327 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.382773:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932263936:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612585.382877:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612585.385660:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932263936:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612585.385688:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.386395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.386453:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357120 00000100:00100000:2.0:1788612585.386460:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357120 00010000:00010000:2.0:1788612585.386549:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 16 pid: 12327 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.386601:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1788612585.386611:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:2394:x1875495914357120:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612585.386625:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612585.386631:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 16 pid: 12327 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.386643:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 16 pid: 12327 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.386663:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc85e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22206 expref: 16 pid: 12327 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.386677:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:2.0:1788612585.386682:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.386691:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.386698:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.386729:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612585.386759:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386770:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.386793:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:2394:x1875495914357120:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 183us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612585.386801:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00010000:00010000:3.0:1788612585.386807:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386826:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386833:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386839:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612585.386844:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386852:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386862:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:3.0:1788612585.386865:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788612585.386869:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.386875:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc861f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.386932:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914356992:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 4323us (4644us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788612585.386941:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1788612585.389912:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.392399:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357248 00000100:00100000:1.0:1788612585.392412:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357248 00000100:00100000:1.0:1788612585.392464:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1788612585.392471:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914357248:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788612585.392538:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.392559:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.392568:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612585.392572:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612585.392595:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.392634:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.392648:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 7 pid: 8440 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.392662:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932264064:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612585.395515:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612585.404922:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612585.404947:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932264064:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612585.404974:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.406902:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357376 00000100:00100000:3.0:1788612585.406916:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357376 00010000:00010000:3.0:1788612585.406960:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 8 pid: 8440 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.407027:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1788612585.407037:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914357376:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612585.407051:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612585.407073:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 8 pid: 8440 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.407086:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 8 pid: 8440 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.407111:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8611 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22222 expref: 8 pid: 8440 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.407132:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612585.407136:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612585.407143:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.407164:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.407203:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612585.407246:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.407260:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.407278:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914357376:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 242us (2364us total) trans 0 rc 0/0 00010000:00010000:1.0:1788612585.407281:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.407290:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00010000:00010000:1.0:1788612585.407296:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.407322:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.407330:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612585.407334:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.407344:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.407359:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.407367:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a9dc224/0x1f8616bf0bc8626 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.407414:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914357248:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 14942us (17510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612585.407423:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1788612585.413025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.413223:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357632 00000100:00100000:2.0:1788612585.413242:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357632 00000100:00100000:2.0:1788612585.413296:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:2.0:1788612585.413307:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11286:x1875495914357632:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788612585.413381:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.413397:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.413407:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.413440:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.413454:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 14 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.413468:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932264192:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612585.413590:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612585.415852:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.415928:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357760 00000100:00100000:0.0:1788612585.415937:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357760 00010000:00010000:0.0:1788612585.415979:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612585.416020:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:0.0:1788612585.416039:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9286c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:2394:x1875495914357760:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612585.416051:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612585.416056:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.416066:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.416083:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:0.0:1788612585.416087:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.416095:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.416100:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.416128:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612585.416137:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc846d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221ab expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.416158:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932264192:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612585.416175:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9286c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:2394:x1875495914357760:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 145us (334us total) trans 0 rc 0/0 00010000:00010000:1.0:1788612585.416181:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612585.416184:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00010000:00010000:1.0:1788612585.416198:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.416205:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.417024:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.417041:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.417050:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.417081:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.417095:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 14 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612585.417109:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932264320:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612585.417218:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612585.419641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.419708:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357888 00000100:00100000:0.0:1788612585.419717:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357888 00000100:00100000:1.0:1788612585.419793:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932264320:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612585.419814:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.419831:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612585.419866:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1788612585.419876:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:2394:x1875495914357888:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612585.419890:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612585.419896:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.419910:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.419929:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc85ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2220d expref: 15 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.419943:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:0.0:1788612585.419947:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.419956:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.419978:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612585.420005:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612585.420046:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:2394:x1875495914357888:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 172us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612585.420053:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00010000:00010000:1.0:1788612585.420105:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612585.420118:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612585.420221:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788612585.420323:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788612585.420351:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788612585.420406:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932264448:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788612585.420446:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612585.420509:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612585.420569:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932264448 00000100:00100000:0.0:1788612585.420573:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932264448 00000100:00100000:0.0:1788612585.420603:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788612585.420609:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875495932264448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788612585.422789:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00100000:0.0:1788612585.422790:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875495932264448:12345-0@lo:1000:mdt00_001.0 Request processed in 2172us (2335us total) trans 0 rc 0/0 00000004:00080000:2.0:1788612585.422799:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9612d8192680, transno 4294967304 00000100:00100000:0.0:1788612585.422805:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788612585.422825:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932264448:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788612585.422974:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788612585.423040:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8190a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932264576:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788612585.423090:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612585.423116:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612585.423441:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932264576 00000100:00100000:1.0:1788612585.423447:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932264576 00000100:00100000:1.0:1788612585.423522:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788612585.423534:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875495932264576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788612585.423665:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1875495932264576:12345-0@lo:1000:mdt00_001.0 Request processed in 134us (574us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788612585.423672:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788612585.423937:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8190a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932264576:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788612585.424055:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424063:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424068:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424072:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612585.424075:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424080:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424092:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:2.0:1788612585.424093:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612585.424097:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424101:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8634 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424127:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424134:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424140:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424155:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612585.424158:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424164:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424174:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:2.0:1788612585.424176:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612585.424179:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424185:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8562 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424233:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424247:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424255:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424281:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.424306:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 17 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.424330:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932264704:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612585.424396:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612585.425860:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932264704:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612585.425883:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.427004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612585.427063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358016 00000100:00100000:0.0:1788612585.427071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358016 00010000:00010000:0.0:1788612585.427108:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 18 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612585.427197:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612585.427210:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2395:x1875495914358016:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612585.427224:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612585.427232:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 18 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.427247:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 18 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.427269:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc857e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d221f1 expref: 18 pid: 6523 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.427285:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:3.0:1788612585.427290:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.427301:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.427309:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.427375:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612585.427430:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:2395:x1875495914358016:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 223us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612585.427454:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00010000:00010000:2.0:1788612585.427515:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427523:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427537:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427544:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427551:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427555:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612585.427558:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427563:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427571:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:2.0:1788612585.427578:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612585.427581:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427586:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc863b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427595:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427599:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427602:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427605:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612585.427606:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427609:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427613:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c76e6d00) 00010000:00010000:2.0:1788612585.427614:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612585.427616:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.427619:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc862d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612585.427750:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11286:x1875495914357632:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 14433us (14723us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788612585.427766:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000020:00080000:2.0:1788612585.427770:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788612585.427813:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612585.427817:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612585.427833:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788612585.427838:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612585.429583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612585.429645:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358272 00000100:00100000:2.0:1788612585.429654:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358272 00000100:00100000:2.0:1788612585.429700:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612585.429709:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11286:x1875495914358272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788612585.430085:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788612585.430122:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788612585.430152:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.430316:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.430329:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.430337:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.430343:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.430349:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612585.430383:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612585.430751:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612585.430758:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.430767:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612585.430772:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.430781:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.430793:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:3.0:1788612585.430796:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612585.430801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.430807:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc8642 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612585.430820:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612585.430822:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612585.430824:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612585.430906:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11286:x1875495914358272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 1195us (1326us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788612585.430915:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000020:00080000:2.0:1788612585.430934:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788612585.456153:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932264832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612585.456229:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612585.456390:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932264832 00000100:00100000:1.0:1788612585.456398:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932264832 00000100:00100000:1.0:1788612585.456451:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788612585.456461:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c1325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932264832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612585.456535:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788612585.456585:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c1325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932264832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612585.456592:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788612585.456689:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932264832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788612585.839942:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612586.073046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612586.073098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612586.073157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612586.073192:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612586.073234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612586.073424:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358912 00000100:00100000:0.0:1788612586.073435:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358912 00000100:00100000:0.0:1788612586.073540:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358528 00000100:00100000:0.0:1788612586.073544:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358528 00000100:00100000:0.0:1788612586.073562:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358784 00000100:00100000:0.0:1788612586.073565:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358784 00000100:00100000:0.0:1788612586.073583:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:0.0:1788612586.073603:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914358912:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612586.073611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358400 00000100:00100000:2.0:1788612586.073617:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358400 00000100:00100000:2.0:1788612586.073652:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 380 00000100:00100000:2.0:1788612586.073660:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914358400:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612586.073680:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914358912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612586.073689:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:2.0:1788612586.073696:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914358400:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612586.073703:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 380 00000100:00100000:0.0:1788612586.073722:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00100000:0.0:1788612586.073732:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914358528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612586.073748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:0.0:1788612586.073765:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914358528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612586.073769:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914358784:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612586.073780:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00100000:2.0:1788612586.073807:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2396:x1875495914358784:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 50us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612586.073814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00080000:1.0:1788612586.073972:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612586.073977:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612586.074046:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358656 00000100:00100000:3.0:1788612586.074057:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358656 00000100:00100000:3.0:1788612586.074104:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1788612586.074113:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914358656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612586.074142:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914358656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612586.074148:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00080000:1.0:1788612586.074336:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788612586.863688:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612586.993817:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612586.993925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932265088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612587.002723:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.002806:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265088 00000100:00100000:0.0:1788612587.002814:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265088 00000100:00100000:0.0:1788612587.002870:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612587.002879:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932265088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612587.002911:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612587.002962:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932265088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.002970:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788612587.002991:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612587.003030:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932265088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612587.003169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932265216:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003206:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.003230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932265728:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.003393:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932266240:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003418:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.003438:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788612587.003443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932265344:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003467:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.003515:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932265856:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003538:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.003554:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932266368:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003574:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.003603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265216 00000100:00100000:0.0:1788612587.003607:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265216 00000100:00100000:0.0:1788612587.003636:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788612587.003656:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932265216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003691:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932265216:12345-0@lo:400:kworker.0 Request processed in 49us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.003698:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788612587.003726:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932266240 00000100:00100000:0.0:1788612587.003730:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932266240 00000100:00100000:0.0:1788612587.003760:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788612587.003766:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932266240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003798:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932266240:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.003803:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788612587.003820:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265344 00000100:00100000:0.0:1788612587.003823:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265344 00000100:00100000:0.0:1788612587.003855:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265856 00000100:00100000:0.0:1788612587.003858:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265856 00000100:00100000:0.0:1788612587.003878:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932266368 00000100:00100000:0.0:1788612587.003881:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932266368 00000100:00100000:0.0:1788612587.003895:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788612587.003900:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932265344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003931:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932265344:12345-0@lo:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.003937:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788612587.003949:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788612587.003955:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932265856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.003993:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932265856:12345-0@lo:400:kworker.0 Request processed in 39us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.004000:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788612587.004013:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788612587.004018:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932266368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.004043:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932266368:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.004049:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:0.0:1788612587.004069:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612587.004072:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612587.004086:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932265600:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.004110:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.004127:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932266112:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.004158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.004180:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932266624:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.004209:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.004229:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788612587.004236:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932265472:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.004257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.004272:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932265984:0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.004696:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612587.004730:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265728 00000100:00100000:1.0:1788612587.004735:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265728 00000100:00100000:1.0:1788612587.004818:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265472 00000100:00100000:1.0:1788612587.004822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265472 00000100:00100000:1.0:1788612587.004836:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788612587.004843:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932265728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.004947:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932265728:12345-0@lo:400:kworker.0 Request processed in 104us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.004955:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788612587.004970:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788612587.004977:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.005009:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932265472:12345-0@lo:400:kworker.0 Request processed in 32us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.005015:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788612587.005033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265600 00000100:00100000:1.0:1788612587.005037:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265600 00000100:00100000:1.0:1788612587.005062:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788612587.005068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932265600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.005113:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932265600:12345-0@lo:400:kworker.0 Request processed in 45us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.005125:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788612587.005144:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932266112 00000100:00100000:1.0:1788612587.005148:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932266112 00000100:00100000:1.0:1788612587.005177:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932266624 00000100:00100000:1.0:1788612587.005181:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932266624 00000100:00100000:1.0:1788612587.005196:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788612587.005202:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932266112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.005234:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932266112:12345-0@lo:400:kworker.0 Request processed in 33us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.005240:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788612587.005251:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788612587.005256:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932266624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.005461:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932266624:12345-0@lo:400:kworker.0 Request processed in 204us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.005468:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788612587.005525:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932264960 00000100:00100000:1.0:1788612587.005529:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932264960 00000100:00100000:1.0:1788612587.005551:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788612587.005557:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875495932264960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612587.005571:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612587.005603:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875495932264960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.005608:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788612587.005627:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612587.005631:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612587.005676:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612587.005993:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932265344:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.008896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.008948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932266496:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.008997:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.009036:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932265600:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.009049:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932266112:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.009060:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932266624:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.009085:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932265472:0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.009123:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932265984 00000100:00100000:0.0:1788612587.009129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932265984 00000100:00100000:0.0:1788612587.009178:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932266496 00000100:00100000:0.0:1788612587.009181:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932266496 00000100:00100000:0.0:1788612587.009202:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788612587.009210:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932265984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612587.009260:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932265984:12345-0@lo:400:kworker.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.009266:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788612587.009433:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788612587.009442:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932266496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612587.009505:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932266496:12345-0@lo:400:kworker.0 Request processed in 65us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612587.009510:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:0.0:1788612587.009563:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788612587.009589:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80ed180 x1875495932265984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612587.009600:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932265984:0@lo:400:kworker.0 00010000:00080000:0.0:1788612587.009622:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80edf80 x1875495932266496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612587.009629:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932266496:0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.011307:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932265856:0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.011330:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932266368:0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.011342:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932265216:0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.011352:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932265728:0@lo:400:kworker.0 00000100:00100000:1.0:1788612587.011375:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932266240:0@lo:400:kworker.0 00000040:00080000:0.0:1788612587.053394:0:14263:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612587.053402:0:14263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612587.053424:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788612587.053430:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788612587.180371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612587.180450:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359168 00000100:00100000:1.0:1788612587.180460:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359168 00000100:00100000:1.0:1788612587.180575:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:1.0:1788612587.180586:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:11303:x1875495914359168:12345-192.168.203.30@tcp:101:lfs.0 00000100:00080000:2.0:1788612587.180613:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612587.180649:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612587.180669:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22229 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.180762:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc8650 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.180776:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc8650 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.180787:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc8650 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612587.180796:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788612587.180882:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22229 expref: 21 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.180905:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc8650 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22229 expref: 20 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.180914:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612587.180917:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612587.180921:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a800, rc 0) 00000100:00100000:1.0:1788612587.181006:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:11303:x1875495914359168:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 421us (644us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788612587.181013:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:0.0:1788612587.184611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.184710:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359296 00000100:00100000:2.0:1788612587.184719:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359296 00000100:00100000:2.0:1788612587.184775:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:2.0:1788612587.184784:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:11303:x1875495914359296:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:2.0:1788612587.184852:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184869:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184881:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184906:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184914:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184921:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184985:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184993:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.184999:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612587.185038:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185049:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185056:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185064:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185070:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612587.185074:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185087:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185098:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:2.0:1788612587.185101:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612587.185105:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185112:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc865e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185124:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185130:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185136:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185142:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612587.185144:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185150:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185156:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9612c8ef5b00) 00010000:00010000:2.0:1788612587.185158:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612587.185160:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185174:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8665 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185191:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185197:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185204:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185209:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612587.185212:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185218:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185225:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9612c8ef5a00) 00010000:00010000:2.0:1788612587.185227:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612587.185229:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.185235:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc866c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612587.185309:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:11303:x1875495914359296:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 526us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612587.185318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:3.0:1788612587.266420:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.266568:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359552 00000100:00100000:0.0:1788612587.266577:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359552 00000100:00100000:0.0:1788612587.266688:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:0.0:1788612587.266699:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:11306:x1875495914359552:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612587.266720:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.266740:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8673 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22230 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.266805:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.266820:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.266832:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.266845:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.266852:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.266871:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267004:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267013:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267021:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612587.267031:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788612587.267116:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267125:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267132:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267138:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.267142:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267150:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267304:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612587.267308:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612587.267319:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267327:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc867a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267341:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267347:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267354:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267359:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.267362:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267369:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267377:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:0.0:1788612587.267379:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612587.267382:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267387:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8681 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267427:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8673 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267453:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.267460:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.267463:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612587.267465:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897c00, rc 0) 00000100:00100000:0.0:1788612587.267581:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11306:x1875495914359552:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 882us (1168us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788612587.267589:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:1.0:1788612587.270794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.270874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359680 00000100:00100000:0.0:1788612587.270884:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359680 00000100:00100000:0.0:1788612587.270939:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:0.0:1788612587.270949:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11306:x1875495914359680:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1788612587.271137:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271153:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271164:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271197:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271204:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271223:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271228:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.271232:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271239:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271252:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.271255:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612587.271259:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.271266:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.271520:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11306:x1875495914359680:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 571us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.271527:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1788612587.274062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.274366:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359936 00000100:00100000:0.0:1788612587.274375:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359936 00000100:00100000:0.0:1788612587.274542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1788612587.274552:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11306:x1875495914359936:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788612587.274750:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:11306:x1875495914359936:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 198us (694us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788612587.274758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1788612587.310271:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.314860:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360192 00000100:00100000:0.0:1788612587.314876:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360192 00000100:00100000:0.0:1788612587.314998:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:0.0:1788612587.315010:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:10825:x1875495914360192:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612587.315034:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.315056:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc869d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22237 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.315167:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.315187:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.315198:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.315239:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.315256:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 24 pid: 12327 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.315271:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932266752:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612587.315410:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612587.322158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.322255:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360320 00000100:00100000:2.0:1788612587.322282:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360320 00010000:00010000:2.0:1788612587.322329:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 25 pid: 12327 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612587.322374:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1788612587.322385:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:2394:x1875495914360320:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612587.322400:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612587.322407:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 25 pid: 12327 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.322421:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 25 pid: 12327 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.322443:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:2.0:1788612587.322448:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.322459:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.322467:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.322544:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612587.322594:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:2394:x1875495914360320:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 211us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612587.322602:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00010000:00010000:0.0:1788612587.324755:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8688 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22230 expref: 24 pid: 12327 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.324782:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932266752:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612587.324820:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.324831:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.324837:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612587.324860:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788612587.324997:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc869d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.325013:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.325020:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.325023:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612587.325026:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896600, rc 0) 00000100:00100000:0.0:1788612587.325092:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:10825:x1875495914360192:12345-192.168.203.30@tcp:101:bash.0 Request processed in 10084us (14829us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788612587.325100:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:3.0:1788612587.329745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.329814:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360448 00000100:00100000:0.0:1788612587.329824:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360448 00000100:00100000:0.0:1788612587.329890:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:0.0:1788612587.329901:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:10825:x1875495914360448:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612587.329922:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.329944:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc86b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2223e expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.329995:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc86b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.330009:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc86b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.330021:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc86b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.330150:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc86b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2223e expref: 26 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.330169:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc86b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2223e expref: 25 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.330177:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.330180:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612587.330183:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897400, rc 0) 00000100:00100000:0.0:1788612587.330253:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:10825:x1875495914360448:12345-192.168.203.30@tcp:101:bash.0 Request processed in 353us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.330260:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:1.0:1788612587.339185:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.339287:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360704 00000100:00100000:0.0:1788612587.339297:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360704 00000100:00100000:0.0:1788612587.339357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:0.0:1788612587.339368:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:10825:x1875495914360704:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:0.0:1788612587.339741:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.339909:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.339923:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612587.339971:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788612587.339995:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b3889cf reply state 00000000764441c0 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.340007:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.340014:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.340018:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612587.340022:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788612587.340514:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788612587.340874:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:10825:x1875495914360704:12345-192.168.203.30@tcp:36:bash.0 Request processed in 1504us (1694us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788612587.340883:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000020:00080000:0.0:1788612587.340889:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788612587.343373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.346465:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360832 00000100:00100000:0.0:1788612587.346552:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360832 00000100:00100000:1.0:1788612587.351258:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:1.0:1788612587.351282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:10825:x1875495914360832:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612587.351306:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612587.351327:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc86c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22245 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.351382:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc86c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22245 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.351408:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc86c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22245 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.351428:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:1.0:1788612587.351443:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612587.351448:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b200, rc 0) 00000100:00100000:1.0:1788612587.351541:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:10825:x1875495914360832:12345-192.168.203.30@tcp:101:bash.0 Request processed in 271us (8175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.351548:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:2.0:1788612587.355596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612587.355652:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360960 00000100:00100000:1.0:1788612587.355662:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360960 00000100:00100000:1.0:1788612587.355723:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1788612587.355731:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:10825:x1875495914360960:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612587.355802:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612587.355823:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2224c expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612587.355849:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c0fe7, atime: 0x6a9c0fe6, ctime: 0x6a9c0fe7, blocks: 0x8 00010000:00010000:1.0:1788612587.355872:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1788612587.355876:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612587.355884:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.355900:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.355912:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b600, rc 0) 00000100:00100000:1.0:1788612587.356022:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:10825:x1875495914360960:12345-192.168.203.30@tcp:101:bash.0 Request processed in 289us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.356029:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00080000:2.0:1788612587.356069:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612587.359144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.359444:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361088 00000100:00100000:2.0:1788612587.359456:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361088 00002000:00010000:2.0:1788612587.360037:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788612587.360043:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6adb800 with x1875495914361088 ext(0->18446744073709551615) 00002000:00010000:2.0:1788612587.360056:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c6adb800. 00000100:00100000:2.0:1788612587.360091:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788612587.360102:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914361088:12345-192.168.203.30@tcp:10:bash.0 00002000:00010000:2.0:1788612587.361139:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788612587.361145:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788612583 -> 1788612587 00002000:00010000:2.0:1788612587.361148:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788612582 -> 1788612582 00002000:00010000:2.0:1788612587.361150:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788612583 -> 1788612587 00002000:00010000:2.0:1788612587.361152:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788612587.361221:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914361088:12345-192.168.203.30@tcp:10:bash.0 Request processed in 1118us (2084us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788612587.361229:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00002000:00010000:2.0:1788612587.361234:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788612587.361237:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6adb800 with x1875495914361088 ext(0->18446744073709551615) 00002000:00010000:2.0:1788612587.361241:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c6adb800. 00000100:00100000:3.0:1788612587.453345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612587.453528:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361216 00000100:00100000:1.0:1788612587.453539:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361216 00000100:00100000:1.0:1788612587.453659:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:1.0:1788612587.453669:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11320:x1875495914361216:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1788612587.453736:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453752:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453763:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453789:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453805:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453812:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453886:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453895:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453903:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612587.453945:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453970:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453977:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453983:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453988:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612587.453992:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.453999:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454012:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612587.454014:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612587.454019:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454024:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc86d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454037:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454043:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454047:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454058:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612587.454061:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454067:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454075:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9612c4d8ab00) 00010000:00010000:1.0:1788612587.454078:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612587.454080:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454086:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc86dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454101:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454106:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454111:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454115:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612587.454117:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454122:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454137:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:1.0:1788612587.454139:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612587.454142:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.454147:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc86e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612587.454218:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11320:x1875495914361216:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 550us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.454227:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:1.0:1788612587.499281:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.499395:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361472 00000100:00100000:0.0:1788612587.499405:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361472 00000100:00100000:0.0:1788612587.499510:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:0.0:1788612587.499522:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11323:x1875495914361472:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612587.499542:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.499564:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc86ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22253 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.499659:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.499673:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.499684:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.499699:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.499706:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.499713:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500065:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc86ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500076:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc86ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500083:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc86ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612587.500093:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788612587.500166:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500174:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500187:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500193:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.500197:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500205:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500216:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612587.500219:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612587.500224:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500230:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc86f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500245:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500251:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500256:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500261:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.500264:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500280:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500288:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:0.0:1788612587.500290:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612587.500294:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500299:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc86f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500338:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc86ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22253 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500352:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc86ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22253 expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.500359:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.500361:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612587.500417:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897a00, rc 0) 00000100:00100000:0.0:1788612587.500891:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11323:x1875495914361472:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 953us (1201us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788612587.500903:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:0.0:1788612587.503602:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788612587.503621:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932267008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612587.503690:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612587.503751:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932266880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612587.503906:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932267008 00000100:00100000:0.0:1788612587.503912:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612587.503913:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932267008 00000100:00100000:3.0:1788612587.503955:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788612587.503965:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932267008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612587.503987:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932266880 00000100:00100000:1.0:1788612587.503991:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932266880 00000004:00000024:3.0:1788612587.503995:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612587.504021:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788612587.504027:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932266880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612587.504045:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612587.504085:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932266880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.504092:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788612587.504111:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932267008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612587.504438:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612587.504449:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932267136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612587.504509:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612587.504580:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932267136 00000100:00100000:2.0:1788612587.504584:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932267136 00000100:00100000:2.0:1788612587.504611:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788612587.504617:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932267136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612587.504630:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612587.504669:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932267136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612587.504675:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788612587.504711:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932267136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612587.504793:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932267008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612587.504820:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932266880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612587.505654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.505697:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361600 00000100:00100000:2.0:1788612587.505703:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361600 00000100:00100000:2.0:1788612587.505748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:2.0:1788612587.505872:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11323:x1875495914361600:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:2.0:1788612587.505928:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.505945:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.505955:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.505984:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.505997:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 32 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612587.506008:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932267264:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612587.506078:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d6c0 going to sleep for 11 seconds 00000001:00080000:2.0:1788612587.510917:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788612587.510935:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788612587.511035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.511075:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361856 00000100:00100000:2.0:1788612587.511083:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361856 00000100:00100000:2.0:1788612587.511145:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1788612587.511156:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:6164:x1875495914361856:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788612587.511435:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:6164:x1875495914361856:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 281us (404us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788612587.511443:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1788612587.511521:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932267264:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612587.511546:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612587.511747:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788612587.517116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.517736:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361984 00000100:00100000:0.0:1788612587.517746:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361984 00010000:00010000:0.0:1788612587.517789:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.517900:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1788612587.517911:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:2395:x1875495914361984:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612587.517925:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612587.517932:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.517945:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.517970:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc86a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22237 expref: 34 pid: 6524 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.517986:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.517992:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.518001:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.518009:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.518163:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612587.518366:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:2395:x1875495914361984:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 456us (1257us total) trans 0 rc 0/0 00010000:00010000:2.0:1788612587.518382:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.518382:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00010000:00010000:2.0:1788612587.518390:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518427:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518435:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518441:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518447:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612587.518451:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518472:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518519:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:2.0:1788612587.518522:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612587.518526:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.518533:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc870d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612587.518574:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11323:x1875495914361600:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 12818us (12922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612587.518582:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:2.0:1788612587.520408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.521113:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362240 00000100:00100000:0.0:1788612587.521123:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362240 00000100:00100000:0.0:1788612587.521214:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612587.521224:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:11323:x1875495914362240:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788612587.521446:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:11323:x1875495914362240:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 222us (1045us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788612587.521453:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1788612587.634951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612587.635010:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362496 00000100:00100000:3.0:1788612587.635082:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362496 00000100:00100000:3.0:1788612587.635151:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:3.0:1788612587.635162:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:11334:x1875495914362496:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1788612587.635187:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612587.635210:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8714 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2225a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635279:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635295:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635310:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635326:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635334:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635341:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635593:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8729 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635604:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635630:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612587.635640:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788612587.635716:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635724:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635731:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635736:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612587.635740:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635747:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635758:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612587.635761:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612587.635765:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635771:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc871b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635783:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635788:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635801:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635806:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612587.635810:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635816:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635825:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c76e6c00) 00010000:00010000:3.0:1788612587.635827:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612587.635830:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635836:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8722 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635881:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8714 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2225a expref: 36 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635895:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2225a expref: 35 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.635903:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:3.0:1788612587.635905:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612587.635908:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240600, rc 0) 00000100:00100000:3.0:1788612587.635976:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11334:x1875495914362496:12345-192.168.203.30@tcp:101:cat.0 Request processed in 816us (1034us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788612587.635991:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:1.0:1788612587.643873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.644047:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362752 00000100:00100000:2.0:1788612587.644057:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362752 00000100:00100000:2.0:1788612587.644160:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1788612587.644169:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11334:x1875495914362752:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:2.0:1788612587.644734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+36:11334:x1875495914362752:12345-192.168.203.30@tcp:35:cat.0 Request processed in 564us (869us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788612587.644742:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1788612587.673351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.673556:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363008 00000100:00100000:0.0:1788612587.673566:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363008 00000100:00100000:0.0:1788612587.673661:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:0.0:1788612587.673671:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+36:11335:x1875495914363008:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1788612587.673722:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788612587.673745:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc86c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22245 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673766:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8729 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2225a expref: 35 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673788:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc86ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22253 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673803:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc86b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2223e expref: 33 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673830:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.673835:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612587.673855:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673868:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673886:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673900:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673908:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673914:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673980:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673988:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.673994:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612587.674193:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788612587.674203:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402057726192ns, next at 403057723364ns, rc = 0 00010000:00010000:0.0:1788612587.674246:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674256:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674263:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674271:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674278:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674284:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674369:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612587.674377:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674384:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612587.674389:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674428:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612587.674447:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674454:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674460:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674465:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674467:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.674514:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674521:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:1.0:1788612587.674525:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788612587.674533:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674554:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:0.0:1788612587.674557:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788612587.674561:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674569:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8745 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674584:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674591:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674597:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674600:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674604:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612587.674609:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674611:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc874c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674619:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.674629:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612587.674629:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612587.674633:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612587.674633:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612587.674638:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612587.674639:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674646:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8737 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612587.674665:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c2c76aa reply state 000000008f5e625a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674676:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.674683:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:0.0:1788612587.674685:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612587.674687:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612587.674752:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:11335:x1875495914363008:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1081us (1408us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788612587.674761:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:1.0:1788612587.760955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.761251:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363264 00000100:00100000:2.0:1788612587.761261:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363264 00000100:00100000:2.0:1788612587.761517:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:2.0:1788612587.761528:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:11341:x1875495914363264:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612587.761565:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612587.761588:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8753 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22261 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.761685:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.761699:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.761710:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.761721:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.761729:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.761735:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612587.763089:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788612587.765710:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.765731:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.765742:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.766982:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.766996:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767004:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767010:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612587.767014:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767022:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767037:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:2.0:1788612587.767040:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612587.767045:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767051:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc875a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612587.767066:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063f2e037 reply state 00000000f4d4ca65 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767078:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767084:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:2.0:1788612587.767096:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612587.767099:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788612587.767142:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8753 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767158:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.767165:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:2.0:1788612587.767168:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612587.767170:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36200, rc 0) 00000100:00100000:2.0:1788612587.767250:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:11341:x1875495914363264:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5724us (6303us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788612587.767258:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:1.0:1788612587.777080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.778586:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363392 00000100:00100000:0.0:1788612587.778599:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363392 00000100:00100000:0.0:1788612587.778731:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1788612587.778742:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2396:x1875495914363392:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612587.778771:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.778798:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22268 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612587.778825:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612587.778845:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788612587.778849:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612587.778859:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.778878:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.778904:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896600, rc 0) 00000100:00100000:0.0:1788612587.778974:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2396:x1875495914363392:12345-192.168.203.30@tcp:101:bash.0 Request processed in 234us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.778981:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1788612587.786421:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.786886:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363520 00000100:00100000:0.0:1788612587.786895:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363520 00000100:00100000:0.0:1788612587.786958:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:0.0:1788612587.786967:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:11341:x1875495914363520:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612587.786983:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.787001:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2226f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.787033:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.787041:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612587.787046:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612587.787052:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.787085:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.787100:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 7 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.788037:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875495932267392:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612587.788457:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612587.794167:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612587.794601:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363648 00000100:00100000:3.0:1788612587.794611:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363648 00010000:00010000:3.0:1788612587.794652:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612587.794699:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788612587.794708:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914363648:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612587.794722:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612587.794745:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.794760:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.794852:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612587.794857:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612587.794867:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.794877:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.794916:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612587.794947:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1875495932267520:192.168.203.30@tcp:105: 00000100:00100000:3.0:1788612587.795074:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788612587.795460:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fd951d/0x1f8616bf0bc8776 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22268 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.795514:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875495932267392:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612587.795540:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.795551:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612587.795585:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11341:x1875495914363520:12345-192.168.203.30@tcp:101:bash.0 Request processed in 8619us (9173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.795592:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1788612587.798333:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1875495932267520:192.168.203.30@tcp:105: 00010000:00010000:3.0:1788612587.798356:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612587.798540:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914363648:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3831us (4380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612587.798550:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:2.0:1788612587.801264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612587.801398:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363904 00000100:00100000:1.0:1788612587.801407:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363904 00000100:00100000:1.0:1788612587.801462:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612587.801508:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:11341:x1875495914363904:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:1.0:1788612587.801780:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11341:x1875495914363904:12345-192.168.203.30@tcp:35:bash.0 Request processed in 309us (523us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788612587.801805:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00010000:00010000:3.0:1788612587.887710:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612587.952097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612587.952215:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364032 00000100:00100000:3.0:1788612587.952224:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364032 00000100:00100000:3.0:1788612587.952279:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:3.0:1788612587.952510:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:11357:x1875495914364032:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612587.952533:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612587.952554:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22276 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.952614:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc878b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.952629:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc878b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.952641:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc878b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612587.952687:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788612587.952701:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612587.952721:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc878b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.952746:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22276 expref: 40 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.952764:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc878b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22276 expref: 39 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612587.952772:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:3.0:1788612587.952775:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612587.952779:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240000, rc 0) 00000100:00100000:3.0:1788612587.952841:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:11357:x1875495914364032:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 372us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612587.952849:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:3.0:1788612587.956583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612587.957585:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364288 00000100:00100000:1.0:1788612587.957596:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364288 00000100:00100000:1.0:1788612587.957670:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:1.0:1788612587.957680:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:11357:x1875495914364288:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612587.957698:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612587.957718:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8792 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2227d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.957818:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.957832:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.957844:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612587.957854:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788612587.959636:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8792 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2227d expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.959662:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2227d expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.959672:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:1.0:1788612587.959675:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612587.959693:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:1.0:1788612587.959758:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+41:11357:x1875495914364288:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 2079us (3184us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1788612587.959768:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:2.0:1788612587.968593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.968648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.968734:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364544 00000100:00100000:0.0:1788612587.968744:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364544 00000100:00100000:0.0:1788612587.968849:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:0.0:1788612587.968860:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+41:11357:x1875495914364544:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612587.968886:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.968905:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22284 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.969008:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc87ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.969036:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc87ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.969049:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc87ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612587.969063:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788612587.969187:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22284 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612587.969189:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364672 00000100:00100000:3.0:1788612587.969193:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364672 00010000:00010000:0.0:1788612587.969204:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc87ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22284 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.969213:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:0.0:1788612587.969216:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788612587.969219:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897400, rc 0) 00000100:00100000:3.0:1788612587.969237:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788612587.969244:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:2394:x1875495914364672:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612587.969252:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612587.969266:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8799 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2227d expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.969273:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:11357:x1875495914364544:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 416us (688us total) trans 4294967381 rc 0/0 00010000:00010000:3.0:1788612587.969277:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00000100:00100000:0.0:1788612587.969279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00010000:00010000:3.0:1788612587.969292:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612587.969315:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:2394:x1875495914364672:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 73us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612587.969328:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612587.974386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.974514:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364800 00000100:00100000:0.0:1788612587.974524:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364800 00000100:00100000:0.0:1788612587.974576:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1788612587.974590:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914364800:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:0.0:1788612587.974632:0:8543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.974652:0:8543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.974675:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612587.974680:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612587.974684:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.974719:0:8543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.974733:0:8543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 6 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.974748:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932267648:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612587.974910:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612587.977209:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612587.977527:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364928 00000100:00100000:2.0:1788612587.977538:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364928 00002000:00100000:2.0:1788612587.977581:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9611c6ad9180 x1875495914364928/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:233/0 lens 504/0 e 0 to 0 dl 1788612598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612587.977593:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6ad9180 with x1875495914364928 ext(0->8) 00010000:00010000:2.0:1788612587.977601:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 7 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.977617:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 7 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612587.977641:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c6ad9180 00000100:00100000:2.0:1788612587.977675:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788612587.977684:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914364928:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:0.0:1788612587.980636:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932267648:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612587.980672:0:8543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612587.980985:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914364928:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 3300us (3782us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788612587.980997:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00002000:00100000:2.0:1788612587.981008:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9611c6ad9180 x1875495914364928/t4294967303(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:233/0 lens 504/448 e 0 to 0 dl 1788612598 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612587.981017:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6ad9180 with x1875495914364928 ext(0->8) 00010000:00010000:2.0:1788612587.981026:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 9 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612587.981041:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 9 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612587.981049:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c6ad9180 00000100:00100000:2.0:1788612587.983370:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.983565:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365056 00000100:00100000:0.0:1788612587.983574:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365056 00010000:00010000:0.0:1788612587.983609:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 9 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.983680:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1788612587.983689:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9285c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2396:x1875495914365056:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612587.983715:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788612587.983730:0:7465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788612587.983733:0:7465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788612587 00002000:00010000:0.0:1788612587.983736:0:7465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788612587 00002000:00010000:0.0:1788612587.983738:0:7465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788612587 00002000:00010000:0.0:1788612587.983740:0:7465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788612587.983746:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 9 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.983759:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 9 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.983780:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc877d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2226f expref: 9 pid: 8441 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.983801:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612587.983806:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612587.983812:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.983825:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.983860:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612587.983908:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9285c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2396:x1875495914365056:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 220us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.983915:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00010000:00010000:1.0:1788612587.984314:0:8543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984325:0:8543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984351:0:8543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984360:0:8543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984368:0:8543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984375:0:8543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612587.984379:0:8543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984387:0:8543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984399:0:8543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.984414:0:8543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e67f65/0x1f8616bf0bc87bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612587.984520:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914364800:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 9935us (10142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612587.984528:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1788612587.989046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612587.989096:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365312 00000100:00100000:1.0:1788612587.989107:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365312 00000100:00100000:1.0:1788612587.989230:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1788612587.989242:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:11357:x1875495914365312:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:1.0:1788612587.989302:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc87ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22284 expref: 42 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612587.989468:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788612587.989577:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788612587.989892:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788612587.989927:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.989942:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.989951:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.989986:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.990013:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 46 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612587.990032:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1875495932267776:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612587.990165:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612587.992823:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1875495932267776:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612587.992855:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612587.993052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.993160:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365440 00000100:00100000:0.0:1788612587.993167:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365440 00010000:00010000:0.0:1788612587.993204:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 47 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612587.993240:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1788612587.993251:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:2395:x1875495914365440:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612587.993265:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612587.993284:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 47 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.993296:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 47 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.993316:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc8768 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22261 expref: 47 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.993331:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:0.0:1788612587.993336:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.993346:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.993353:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.993380:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612587.993428:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+46:2395:x1875495914365440:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 179us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.993463:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00010000:00010000:1.0:1788612587.993907:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.993917:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612587.994012:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788612587.994114:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788612587.994224:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932267904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788612587.994383:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612587.994416:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612587.994588:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932267904 00000100:00100000:0.0:1788612587.994595:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932267904 00000100:00100000:0.0:1788612587.994632:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788612587.994642:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875495932267904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788612587.995065:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875495932267904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 422us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612587.995073:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788612587.995140:0:6527:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788612587.995146:0:6527:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788612587.995164:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961301805f80, transno 4294967302 00000100:00100000:1.0:1788612587.995188:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932267904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788612587.995304:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788612587.995354:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932268032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788612587.995397:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612587.995421:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612587.995449:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932268032 00000100:00100000:3.0:1788612587.995454:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932268032 00000100:00100000:3.0:1788612587.995511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788612587.995519:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1875495932268032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788612587.995631:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1875495932268032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (235us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788612587.995639:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788612587.995676:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875495932268032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788612587.995715:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788612587.995745:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.995756:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.995763:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.995769:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612587.995773:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.995781:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.995796:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:1.0:1788612587.995799:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788612587.995802:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612587.995808:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc87c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612587.995894:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788612587.995946:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788612587.995957:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402379479958ns, next at 403379477773ns, rc = 0 00000001:00080000:1.0:1788612587.995970:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788612587.995993:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9612c8ef5d00) 00010000:00010000:1.0:1788612587.995996:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788612587.996002:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc87ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22284 expref: 50 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612587.996093:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+49:11357:x1875495914365312:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 6854us (7054us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788612587.996101:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000020:00080000:1.0:1788612587.996104:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788612587.999697:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612587.999767:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365568 00000100:00100000:0.0:1788612587.999776:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365568 00000100:00100000:0.0:1788612587.999835:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:0.0:1788612587.999844:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+49:11357:x1875495914365568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612587.999865:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612587.999886:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc87ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2228b expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.999942:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc87ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2228b expref: 50 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.999958:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc87ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2228b expref: 50 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612587.999977:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612587.999980:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612587.999984:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612588.000042:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+50:11357:x1875495914365568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 199us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.000064:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:3.0:1788612588.003770:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.003874:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365824 00000100:00100000:2.0:1788612588.003884:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365824 00000100:00100000:2.0:1788612588.003939:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612588.003949:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+50:11357:x1875495914365824:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612588.004165:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+51:11357:x1875495914365824:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 216us (404us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788612588.004185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612588.077657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.077760:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365952 00000100:00100000:0.0:1788612588.077771:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365952 00000100:00100000:0.0:1788612588.077834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:0.0:1788612588.077844:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+51:11367:x1875495914365952:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:0.0:1788612588.077924:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.077939:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.077949:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.077961:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.077969:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.077976:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078040:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078049:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078056:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612588.078124:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078136:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078144:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078152:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078157:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612588.078161:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078168:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078178:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612588.078181:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612588.078185:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078192:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078207:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078214:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078225:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078230:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612588.078233:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078238:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078244:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:0.0:1788612588.078246:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612588.078249:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078255:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078265:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078271:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078277:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078294:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612588.078297:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078312:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078320:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612588.078323:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612588.078326:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.078332:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.078410:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+51:11367:x1875495914365952:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 563us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.078418:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1788612588.119957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.120040:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366208 00000100:00100000:0.0:1788612588.120050:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366208 00000100:00100000:0.0:1788612588.120115:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:0.0:1788612588.120126:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+51:11370:x1875495914366208:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612588.120146:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612588.120167:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22292 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120239:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120254:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120275:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120295:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120303:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120310:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120423:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120432:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120439:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612588.120447:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788612588.120565:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120573:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120579:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120584:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612588.120588:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120607:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120618:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:0.0:1788612588.120622:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612588.120626:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120632:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc87ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120645:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120650:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120655:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120659:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612588.120662:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120668:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120675:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:0.0:1788612588.120677:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612588.120680:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120695:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc87f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120727:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc87e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120740:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 53 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.120748:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612588.120750:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612588.120753:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896c00, rc 0) 00000100:00100000:0.0:1788612588.120939:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:11370:x1875495914366208:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 814us (990us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788612588.120947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:2.0:1788612588.127108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.127248:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366336 00000100:00100000:0.0:1788612588.127258:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366336 00000100:00100000:0.0:1788612588.127338:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:0.0:1788612588.127349:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:11370:x1875495914366336:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1788612588.127415:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127437:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127450:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127545:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127552:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127558:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127564:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612588.127568:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127574:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127586:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612588.127588:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612588.127593:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.127599:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8809 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.127666:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:11370:x1875495914366336:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 318us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.127672:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:3.0:1788612588.130029:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.130116:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366592 00000100:00100000:2.0:1788612588.130137:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366592 00000100:00100000:2.0:1788612588.130190:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1788612588.130200:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+53:11370:x1875495914366592:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612588.130730:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11370:x1875495914366592:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 529us (707us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788612588.130739:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:3.0:1788612588.204164:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.204294:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366848 00000100:00100000:1.0:1788612588.204304:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366848 00000100:00100000:1.0:1788612588.204363:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:1.0:1788612588.204372:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11380:x1875495914366848:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612588.204394:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.204397:0:12327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612588.204425:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc878b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22276 expref: 54 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.204445:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612588.204450:0:12327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612588.204463:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8810 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22299 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.205220:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.205236:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.205256:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.205288:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.205315:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 54 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.205329:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268160:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612588.205427:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612588.211534:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.211624:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366976 00000100:00100000:2.0:1788612588.211633:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366976 00010000:00010000:2.0:1788612588.211672:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 55 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.211715:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1788612588.211729:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:2395:x1875495914366976:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612588.211742:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612588.211749:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 55 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.211763:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 55 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.211786:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.211791:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.211812:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.211821:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.211838:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612588.211885:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:2395:x1875495914366976:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 162us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.211892:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00010000:00010000:1.0:1788612588.212058:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc87fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22292 expref: 54 pid: 6524 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.212075:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268160:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612588.212093:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.212102:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.212109:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612588.212134:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788612588.212257:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8810 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 55 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.212283:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 54 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.212302:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612588.212306:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612588.212308:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ba00, rc 0) 00000100:00100000:1.0:1788612588.212332:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11380:x1875495914366848:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7961us (8177us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788612588.212339:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1788612588.217830:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.218097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367104 00000100:00100000:2.0:1788612588.218108:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367104 00000100:00100000:2.0:1788612588.218175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1788612588.218186:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:11380:x1875495914367104:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612588.218207:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612588.218227:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8825 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222a0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.218258:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.218272:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.218284:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.218389:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8825 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.218415:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.218424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.218427:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612588.218431:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36600, rc 0) 00000100:00100000:2.0:1788612588.218716:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:11380:x1875495914367104:12345-192.168.203.30@tcp:101:bash.0 Request processed in 531us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.218734:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:0.0:1788612588.223131:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.223249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367360 00000100:00100000:1.0:1788612588.223258:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367360 00000100:00100000:1.0:1788612588.223387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:1.0:1788612588.223399:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:11380:x1875495914367360:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:1.0:1788612588.224089:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.224108:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.224120:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612588.224164:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788612588.224190:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c723797 reply state 00000000cb89a842 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.224203:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.224225:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612588.224228:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612588.224232:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612588.224442:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11380:x1875495914367360:12345-192.168.203.30@tcp:36:bash.0 Request processed in 1044us (1318us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788612588.224451:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000020:00080000:1.0:1788612588.224456:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788612588.228516:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.228662:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367488 00000100:00100000:1.0:1788612588.228679:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367488 00000100:00100000:1.0:1788612588.228735:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:1.0:1788612588.228745:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11380:x1875495914367488:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612588.228767:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.228786:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc883a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222a7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.228883:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.228898:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 59 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.228907:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.228943:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 59 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.228957:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 59 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.228984:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268288:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612588.229077:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612588.231968:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268288:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612588.232001:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.232620:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.232969:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367616 00000100:00100000:1.0:1788612588.232976:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367616 00010000:00010000:1.0:1788612588.233021:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 60 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.233060:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1788612588.233072:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:2394:x1875495914367616:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612588.233085:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612588.233092:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 60 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.233104:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 60 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.233125:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8817 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22299 expref: 60 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.233140:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612588.233145:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.233162:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.233170:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.233205:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612588.233266:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:2394:x1875495914367616:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 196us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.233274:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00010000:00010000:2.0:1788612588.233453:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.233462:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612588.233557:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788612588.233561:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612588.233583:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.233613:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc883a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 59 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.233627:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 58 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.233634:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.233643:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612588.233646:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a000, rc 0) 00000100:00100000:2.0:1788612588.233686:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11380:x1875495914367488:12345-192.168.203.30@tcp:101:bash.0 Request processed in 4942us (5214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.233693:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:0.0:1788612588.240224:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.240447:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367872 00000100:00100000:1.0:1788612588.240457:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367872 00000100:00100000:1.0:1788612588.240690:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1788612588.240701:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:11380:x1875495914367872:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:1.0:1788612588.240931:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:11380:x1875495914367872:12345-192.168.203.30@tcp:35:bash.0 Request processed in 231us (717us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788612588.240938:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1788612588.322346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.322446:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368000 00000100:00100000:2.0:1788612588.322455:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368000 00000100:00100000:2.0:1788612588.322546:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:2.0:1788612588.322557:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:11386:x1875495914368000:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612588.322579:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612588.322599:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222ae expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.322670:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc884f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.322685:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.322697:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612588.322736:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788612588.322740:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612588.322760:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc884f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.322784:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ae expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.322820:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc884f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ae expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.322828:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:2.0:1788612588.322830:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612588.322834:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36200, rc 0) 00000100:00100000:2.0:1788612588.322897:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11386:x1875495914368000:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 342us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.322904:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:0.0:1788612588.337348:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.337412:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368128 00000100:00100000:1.0:1788612588.337422:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368128 00000100:00100000:0.0:1788612588.337528:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:0.0:1788612588.337540:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11386:x1875495914368128:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612588.337631:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.337671:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8856 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222b5 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337733:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337747:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337789:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337801:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337808:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337814:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337881:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337889:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337895:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612588.337932:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788612588.337937:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612588.337955:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337965:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337973:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337989:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.337995:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338001:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.338005:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338013:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338025:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612588.338028:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.338033:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338038:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc885d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338051:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338056:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338061:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338066:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.338074:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338080:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338093:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:1.0:1788612588.338096:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.338099:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338105:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8864 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338132:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 62 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338147:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 61 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.338153:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612588.338155:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612588.338157:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ac00, rc 0) 00000100:00100000:1.0:1788612588.338216:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11386:x1875495914368128:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 679us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.338223:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:3.0:1788612588.347222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.347276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.347525:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368384 00000100:00100000:2.0:1788612588.347534:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368384 00000100:00100000:2.0:1788612588.347601:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:2.0:1788612588.347611:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11386:x1875495914368384:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612588.347630:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612588.347650:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8872 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222bc expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347763:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347789:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347798:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 62 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347825:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347865:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 62 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347877:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 62 pid: 8253 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.347890:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301760700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268416:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612588.347985:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.347995:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.348003:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301763480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268544:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612588.348027:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612588.354804:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368512 00000100:00100000:0.0:1788612588.354820:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368512 00010000:00010000:0.0:1788612588.354942:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 63 pid: 8253 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.354990:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:0.0:1788612588.355000:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:2395:x1875495914368512:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612588.355014:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612588.355021:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 63 pid: 8253 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.355034:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 63 pid: 8253 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.355055:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612588.355060:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.355068:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.355075:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612588.355140:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:2395:x1875495914368512:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 142us (7863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.355160:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1788612588.362427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1788612588.363047:0:12327:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.30@tcp) returned -22 from blocking AST (req@000000006afa19d9 x1875495932268416) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 62 pid: 8253 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.363070:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc886b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222b5 expref: 62 pid: 8253 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.363088:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301760700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268416:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612588.363120:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301763480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932268544:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612588.363144:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.363150:0:12327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.363158:0:12327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.363167:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.363243:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368640 00000100:00100000:0.0:1788612588.363250:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368640 00010000:00010000:0.0:1788612588.363285:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.363328:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:0.0:1788612588.363337:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:2394:x1875495914368640:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612588.363351:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612588.363357:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.363368:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.363385:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8841 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a7 expref: 62 pid: 12327 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.363395:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612588.363398:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.363406:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.363414:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.363451:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612588.363576:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:2394:x1875495914368640:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 239us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.363584:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00010000:00010000:2.0:1788612588.363744:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.363752:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612588.363768:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788612588.363904:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8872 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 62 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.363918:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 61 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.363925:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.363928:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612588.363930:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36e00, rc 0) 00000100:00100000:2.0:1788612588.363968:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11386:x1875495914368384:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 16358us (16757us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788612588.363985:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1788612588.371001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.371115:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368896 00000100:00100000:0.0:1788612588.371124:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368896 00000100:00100000:0.0:1788612588.371193:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1788612588.371204:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11386:x1875495914368896:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:0.0:1788612588.371225:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612588.371249:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc87ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2228b expref: 61 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.371268:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612588.371273:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612588.371325:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11386:x1875495914368896:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.371333:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1788612588.382820:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.382925:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369024 00000100:00100000:2.0:1788612588.382935:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369024 00000100:00100000:2.0:1788612588.383002:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:2.0:1788612588.383012:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11386:x1875495914369024:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1788612588.383114:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.383133:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.383144:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612588.383234:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788612588.383310:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11386:x1875495914369024:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 298us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.383318:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1788612588.387065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.387564:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369152 00000100:00100000:2.0:1788612588.387771:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369152 00000100:00100000:2.0:1788612588.387836:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:2.0:1788612588.387848:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:11386:x1875495914369152:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612588.387868:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612588.387889:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222c3 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.387939:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.387966:0:8253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 61 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.387986:0:8253:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.387999:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 61 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.388012:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.388015:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612588.388018:0:8253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 61 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.388026:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36400, rc 0) 00000100:00100000:2.0:1788612588.388090:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11386:x1875495914369152:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 244us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.388107:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000040:00080000:3.0:1788612588.527840:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612588.527849:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612588.527899:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788612588.527907:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612588.528033:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932268672:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612588.528255:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788612588.537741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.537887:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932268672:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612588.539113:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369280 00000100:00100000:2.0:1788612588.539124:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369280 00000100:00100000:2.0:1788612588.539199:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:2.0:1788612588.539210:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11387:x1875495914369280:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788612588.539247:0:12327:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788612588.539400:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11387:x1875495914369280:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 190us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.539408:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:0.0:1788612588.544438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.544577:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369408 00000100:00100000:1.0:1788612588.544587:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369408 00000100:00100000:1.0:1788612588.544713:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1788612588.544724:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11387:x1875495914369408:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788612588.544805:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544822:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544844:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544868:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544875:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544882:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544903:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544911:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544918:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612588.544960:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788612588.544964:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612588.544976:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544992:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.544998:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545005:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545010:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.545014:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545021:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545044:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:1.0:1788612588.545047:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.545052:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545058:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8895 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545070:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545075:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545081:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545091:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.545094:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545111:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545119:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9612c4d8ab00) 00010000:00010000:1.0:1788612588.545122:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.545124:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545130:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc889c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545143:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545149:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545155:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545159:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799bc00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.545162:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545167:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545183:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612588.545185:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.545188:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.545194:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.545263:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11387:x1875495914369408:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 540us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.545270:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:0.0:1788612588.555755:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.556130:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369664 00000100:00100000:2.0:1788612588.556141:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369664 00000100:00100000:2.0:1788612588.556208:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1788612588.556218:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+61:11387:x1875495914369664:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612588.556238:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612588.556259:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222ca expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556374:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556389:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556400:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612588.556411:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788612588.556512:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556520:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556526:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556532:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.556536:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556543:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556570:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.556573:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788612588.556578:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556584:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556625:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ca expref: 63 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556634:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:2.0:1788612588.556637:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612588.556641:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ca expref: 63 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.556650:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37c00, rc 0) 00000100:00100000:2.0:1788612588.556716:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:11387:x1875495914369664:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 500us (970us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788612588.556723:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:0.0:1788612588.559055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.559429:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369792 00000100:00100000:2.0:1788612588.559438:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369792 00000100:00100000:2.0:1788612588.559525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:2.0:1788612588.559535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:11387:x1875495914369792:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788612588.559571:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788612588.559673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:11387:x1875495914369792:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 139us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.559697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:0.0:1788612588.570583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.570671:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370048 00000100:00100000:1.0:1788612588.570680:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370048 00000100:00100000:1.0:1788612588.570749:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:1.0:1788612588.570759:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:11387:x1875495914370048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612588.570778:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.570781:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612588.570806:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36200/0x1f8616bf0bc884f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ae expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.570825:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612588.570830:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612588.570843:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222d1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612588.571423:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788612588.571655:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc88c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.571685:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc88c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.571695:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc88c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.571748:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d1 expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.571764:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc88c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d1 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.571783:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8ab00) 00010000:00010000:1.0:1788612588.571785:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612588.571788:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:1.0:1788612588.571843:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:11387:x1875495914370048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1086us (1276us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788612588.571851:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:0.0:1788612588.581383:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.581964:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370304 00000100:00100000:2.0:1788612588.581975:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370304 00000100:00100000:2.0:1788612588.582044:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:2.0:1788612588.582055:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:11387:x1875495914370304:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612588.582120:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612588.582146:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc88c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d1 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582165:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8ab00) 00010000:00010000:2.0:1788612588.582173:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612588.582204:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582218:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582228:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582438:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582448:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582455:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582601:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582836:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582844:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.582850:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.582854:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583078:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583092:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:2.0:1788612588.583095:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612588.583141:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583148:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc88d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583161:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583166:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583171:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583176:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.583186:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583192:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583201:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa94329ed (ffff9612c8ef5800) 00010000:00010000:2.0:1788612588.583203:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612588.583206:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.583212:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc88db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa94329ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.595008:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:11387:x1875495914370304:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 12942us (13623us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612588.595022:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1788612588.597944:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.598046:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370432 00000100:00100000:1.0:1788612588.598056:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370432 00000100:00100000:1.0:1788612588.598151:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1788612588.598162:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+62:11387:x1875495914370432:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612588.598181:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.598204:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222d8 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.598237:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.598263:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.598286:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.598385:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc88e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 64 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.598403:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 63 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.598412:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:1.0:1788612588.598415:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612588.598418:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b000, rc 0) 00000100:00100000:1.0:1788612588.599157:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:11387:x1875495914370432:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 994us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.599167:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:3.0:1788612588.604923:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.611227:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370688 00000100:00100000:2.0:1788612588.611242:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370688 00000100:00100000:2.0:1788612588.611328:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:2.0:1788612588.611339:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:11387:x1875495914370688:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612588.611421:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.611438:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.611450:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612588.611646:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788612588.611698:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0a38ec1 reply state 0000000045dae0c1 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.611711:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.611733:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:2.0:1788612588.611736:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788612588.611740:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612588.611851:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:11387:x1875495914370688:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 513us (6936us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788612588.611870:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1788612588.614676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.615052:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370816 00000100:00100000:1.0:1788612588.615062:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370816 00000100:00100000:1.0:1788612588.615121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1788612588.615131:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:11387:x1875495914370816:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612588.615151:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.615171:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222df expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.615223:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.615252:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.615271:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:1.0:1788612588.615273:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612588.615289:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ae00, rc 0) 00000100:00100000:1.0:1788612588.615336:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:11387:x1875495914370816:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 207us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.615343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1788612588.619424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.620125:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370944 00000100:00100000:3.0:1788612588.620137:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370944 00000100:00100000:3.0:1788612588.620203:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1788612588.620213:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914370944:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788612588.620428:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914370944:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 216us (1013us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788612588.620438:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1788612588.626793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.626906:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371200 00000100:00100000:0.0:1788612588.626916:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371200 00000100:00100000:0.0:1788612588.626971:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1788612588.626980:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:11387:x1875495914371200:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788612588.627351:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:11387:x1875495914371200:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 370us (565us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788612588.627359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1788612588.636386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.636548:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371456 00000100:00100000:3.0:1788612588.636557:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371456 00000100:00100000:1.0:1788612588.636711:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:1.0:1788612588.636725:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:11387:x1875495914371456:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788612588.636864:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:11387:x1875495914371456:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 135us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.636873:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:1.0:1788612588.640270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.640596:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371584 00000100:00100000:0.0:1788612588.640615:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371584 00000100:00100000:0.0:1788612588.640679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:0.0:1788612588.640689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:11387:x1875495914371584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612588.640709:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612588.640728:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc88fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222e6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.640806:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8905 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.640821:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.640834:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612588.640887:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612588.640905:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.640949:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc88fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222e6 expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.640968:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222e6 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.640976:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:0.0:1788612588.640980:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612588.640983:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897800, rc 0) 00000100:00100000:0.0:1788612588.641057:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:11387:x1875495914371584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 369us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.641064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:0.0:1788612588.645409:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.645503:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371712 00000100:00100000:3.0:1788612588.645517:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371712 00000100:00100000:3.0:1788612588.645570:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1788612588.645578:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914371712:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612588.645594:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612588.645769:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222ed expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612588.645794:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c0fec, blocks: 0x0 00010000:00010000:3.0:1788612588.645812:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1788612588.645816:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612588.645825:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 10 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.646151:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 10 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.646165:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:3.0:1788612588.646224:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2395:x1875495914371712:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 646us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612588.646230:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1788612588.653096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.653516:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371968 00000100:00100000:0.0:1788612588.653526:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371968 00000100:00100000:0.0:1788612588.653579:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:0.0:1788612588.653590:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:11387:x1875495914371968:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612588.653719:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:11387:x1875495914371968:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 130us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.653727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:1.0:1788612588.661886:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.662116:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372096 00000100:00100000:3.0:1788612588.662126:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372096 00000100:00100000:3.0:1788612588.662183:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1788612588.662193:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:11387:x1875495914372096:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612588.662209:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612588.662226:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222f4 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.662257:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 11 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.662266:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612588.662270:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612588.662276:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.662318:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 11 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.662343:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 11 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.662357:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932268800:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612588.662454:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612588.665690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.665899:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372224 00000100:00100000:2.0:1788612588.665908:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372224 00010000:00010000:2.0:1788612588.665945:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 12 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.665992:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:2.0:1788612588.666002:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9287850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:2394:x1875495914372224:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612588.666016:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612588.666152:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 12 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.666167:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 12 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.666193:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612588.666198:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612588.666206:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.666236:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.666273:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.666301:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1875495932268928:192.168.203.30@tcp:105: 00000100:00100000:2.0:1788612588.666381:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00010000:00010000:1.0:1788612588.666721:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc890c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222ed expref: 12 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.666748:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932268800:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612588.666772:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.666782:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241600, rc 0) 00000100:00100000:1.0:1788612588.666826:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:11387:x1875495914372096:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4635us (4948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.666834:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1788612588.673592:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1875495932268928:192.168.203.30@tcp:105: 00010000:00010000:2.0:1788612588.673619:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612588.673682:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9287850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2394:x1875495914372224:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 7680us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.673694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:2.0:1788612588.677322:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.677460:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372352 00000100:00100000:3.0:1788612588.677514:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372352 00002000:00100000:3.0:1788612588.677561:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff961301761180 x1875495914372352/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:234/0 lens 504/0 e 0 to 0 dl 1788612599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612588.677572:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961301761180 with x1875495914372352 ext(0->12) 00002000:00010000:3.0:1788612588.677577:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff961301761180 00000100:00100000:3.0:1788612588.677608:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1788612588.677616:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2394:x1875495914372352:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788612588.679157:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:2394:x1875495914372352:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 1534us (1836us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788612588.679170:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00002000:00100000:3.0:1788612588.679181:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff961301761180 x1875495914372352/t4294967309(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:234/0 lens 504/448 e 0 to 0 dl 1788612599 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612588.679190:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961301761180 with x1875495914372352 ext(0->12) 00002000:00010000:3.0:1788612588.679195:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff961301761180 00000100:00100000:3.0:1788612588.687252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.687380:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372480 00000100:00100000:2.0:1788612588.687390:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372480 00000100:00100000:2.0:1788612588.687444:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1788612588.687451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:11387:x1875495914372480:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788612588.692657:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:3.0:1788612588.692860:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692873:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692881:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692887:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612588.692891:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692900:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692915:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9612c4d8b300) 00010000:00010000:3.0:1788612588.692918:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612588.692922:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692928:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8618 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692954:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692961:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.692967:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612588.692989:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1788612588.692990:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612588.692995:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693002:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693010:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9611c67a4d00) 00010000:00010000:3.0:1788612588.693012:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612588.693015:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693021:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc86c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693108:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693114:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693120:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693125:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612588.693128:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693137:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693157:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:3.0:1788612588.693160:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612588.693164:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693171:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc873e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693183:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693189:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693196:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693201:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612588.693204:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693210:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693218:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9611c67a4600) 00010000:00010000:3.0:1788612588.693221:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612588.693221:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932269056:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788612588.693225:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693234:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8761 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693253:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693259:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693265:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693270:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612588.693274:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693280:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693287:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:3.0:1788612588.693290:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612588.693293:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693299:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8833 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.693312:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612588.693313:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693321:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693327:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693339:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612588.693343:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693350:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693360:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:3.0:1788612588.693363:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788612588.693366:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.693372:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc88f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.693433:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932269056 00000100:00100000:2.0:1788612588.693441:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932269056 00000100:00100000:2.0:1788612588.693512:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612588.693522:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932269056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788612588.693546:0:8543:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788612588.693578:0:8543:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c0feb, atime: 0x6a9c0feb, ctime: 0x6a9c0feb, blocks: 0x8 00010000:00010000:2.0:1788612588.693591:0:8543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.693610:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1788612588.693614:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612588.693621:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.693638:0:8543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.693646:0:8543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.693653:0:8543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.693676:0:8543:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788612588.693829:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875495932269056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (518us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788612588.693836:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1788612588.693877:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961301763b80/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788612588.693883:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932269056:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788612588.694341:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612588.694348:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.694358:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612588.694362:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.694372:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.694388:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.694408:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc891a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788612588.694417:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9612d043ed80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788612588.694423:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fcd72900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9612d043e600 00000020:00080000:1.0:1788612588.694427:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fcd72300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9611c7868a00 00010000:00010000:3.0:1788612588.694429:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612588.694432:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612588.694434:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788612588.694459:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788612588.694523:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9612d819d240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788612588.694527:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612c4fc8000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9612d819db40 00000020:00080000:1.0:1788612588.694530:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612c4fc8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9611c64a2200 00000020:00080000:2.0:1788612588.694810:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788612588.694856:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788612588.695005:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11387:x1875495914372480:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 7550us (7765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612588.695024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1788612588.695826:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612588.695843:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932269184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788612588.695898:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612588.695983:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932269184 00000100:00100000:1.0:1788612588.695991:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932269184 00000100:00100000:1.0:1788612588.696039:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788612588.696049:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932269184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788612588.696076:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788612588.696099:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.696119:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.696128:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788612588.696132:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612588.696137:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.696180:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.696195:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 11 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.696209:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875495932269312:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612588.696270:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612588.698132:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.698202:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372608 00000100:00100000:0.0:1788612588.698211:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372608 00000100:00100000:0.0:1788612588.698262:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1788612588.698271:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:2395:x1875495914372608:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788612588.700457:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788612588.700504:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1788612588.701141:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914372608:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 2864us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612588.701153:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1788612588.704958:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875495932269312:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612588.704990:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.705017:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.705072:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372736 00000100:00100000:1.0:1788612588.705079:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372736 00010000:00010000:1.0:1788612588.705116:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 7 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.705153:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1788612588.705163:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914372736:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612588.705176:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612588.705181:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 7 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.705214:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 7 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.705236:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009677b68f/0x1f8616bf0bc86ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2224c expref: 7 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.705251:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612588.705255:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612588.705261:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.705270:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.705804:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612588.705867:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914372736:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 703us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.705875:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00010000:00010000:2.0:1788612588.710677:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.710707:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.710721:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.710728:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.710757:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612588.710970:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612588.710978:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.710981:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932269184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14929us (15078us total) trans 4294967310 rc 0/0 00010000:00010000:3.0:1788612588.710997:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc0c3f4f0) 00000100:00100000:2.0:1788612588.711001:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1788612588.711005:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.711017:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.711048:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.711074:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8921 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.711107:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612588.711109:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612588.711111:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612588.711169:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788612588.711176:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788612588.711197:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9611c815ed80 x1875495932269184/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788612604 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788612588.711209:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c815ed80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788612588.711227:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932269184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788612588.718851:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.719330:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372992 00000100:00100000:3.0:1788612588.719341:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372992 00000100:00100000:3.0:1788612588.719414:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1788612588.719425:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11387:x1875495914372992:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612588.719514:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612588.719540:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8905 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222e6 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.719560:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:3.0:1788612588.719565:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612588.719593:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.719606:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.719615:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612588.719875:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b37511de reply state 00000000a7c4ddae transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.719907:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.719913:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:3.0:1788612588.719916:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612588.719919:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612588.720015:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:11387:x1875495914372992:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 590us (1171us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788612588.720293:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1788612588.724528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.724958:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373120 00000100:00100000:0.0:1788612588.724967:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373120 00000100:00100000:0.0:1788612588.725031:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1788612588.725041:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914373120:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788612588.725171:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788612588.725174:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788612588 00002000:00010000:0.0:1788612588.725176:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788612587 00002000:00010000:0.0:1788612588.725178:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788612588 -> 1788612588 00002000:00010000:0.0:1788612588.725180:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788612588.725237:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2397:x1875495914373120:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 197us (774us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788612588.725245:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1788612588.732803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.732973:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373376 00000100:00100000:1.0:1788612588.732997:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373376 00000100:00100000:1.0:1788612588.733063:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:1.0:1788612588.733073:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:11387:x1875495914373376:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788612588.733145:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.733162:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 17 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.733171:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.733204:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 17 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.733218:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 17 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.733233:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932269440:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612588.733320:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612588.739095:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932269440:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612588.739126:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.740890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.741157:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373504 00000100:00100000:0.0:1788612588.741168:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373504 00010000:00010000:0.0:1788612588.741210:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 18 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.741250:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1788612588.741260:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2395:x1875495914373504:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612588.741282:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612588.741289:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 18 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.741302:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 18 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.741342:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc88e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222d8 expref: 18 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.741359:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:0.0:1788612588.741363:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.741372:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.741379:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.741413:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612588.741527:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:2395:x1875495914373504:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 268us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612588.741535:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00010000:00010000:1.0:1788612588.741817:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741826:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741875:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741882:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741888:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741895:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.741899:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741906:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741916:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:1.0:1788612588.741919:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788612588.741922:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.741928:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc892f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.741971:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11387:x1875495914373376:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 8900us (9178us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788612588.741979:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:3.0:1788612588.745783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.748609:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373632 00000100:00100000:0.0:1788612588.748623:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373632 00000100:00100000:0.0:1788612588.748721:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1788612588.748731:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fee31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914373632:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788612588.748777:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.748798:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.748825:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612588.748830:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612588.748835:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.748885:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.748900:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 7 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.748914:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875495932269568:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612588.749004:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612588.753089:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.753331:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875495932269568:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612588.753357:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.755917:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373760 00000100:00100000:3.0:1788612588.755932:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373760 00010000:00010000:3.0:1788612588.755975:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 8 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.756309:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:3.0:1788612588.756322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914373760:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612588.756337:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612588.756359:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 8 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.756373:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 8 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.756411:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc8913 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222f4 expref: 8 pid: 8440 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.756427:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612588.756431:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612588.756436:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.756447:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.756519:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612588.756583:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914373760:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 265us (3506us total) trans 0 rc 0/0 00010000:00010000:1.0:1788612588.756631:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756654:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756674:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756683:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756691:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756698:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612588.756702:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756712:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756725:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.756733:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc8936 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.756793:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fee31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914373632:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 8063us (11019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.756801:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612588.761142:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:0.0:1788612588.761639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612588.761946:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374016 00000100:00100000:2.0:1788612588.761956:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374016 00000100:00100000:2.0:1788612588.762040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:2.0:1788612588.762051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:11387:x1875495914374016:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788612588.762127:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.762155:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.762165:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.762197:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.762211:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 16 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.762225:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301760380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932269696:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612588.762314:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612588.767187:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301760380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932269696:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612588.767425:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.767964:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.768034:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374144 00000100:00100000:3.0:1788612588.768043:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374144 00010000:00010000:3.0:1788612588.768080:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 17 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.768123:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1788612588.768133:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:2394:x1875495914374144:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612588.768150:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612588.768157:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 17 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768188:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 17 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768214:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc882c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222a0 expref: 17 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768231:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:3.0:1788612588.768236:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 16 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768245:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768252:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768260:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.768289:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612588.768344:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:2394:x1875495914374144:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 212us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612588.768352:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00010000:00010000:2.0:1788612588.768718:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.768727:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.768886:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.768898:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.768906:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.768948:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.768961:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 16 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.768974:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932269824:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612588.769042:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612588.774264:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932269824:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612588.774305:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.774658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.775040:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374272 00000100:00100000:3.0:1788612588.775048:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374272 00010000:00010000:3.0:1788612588.775088:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 17 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.775146:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:3.0:1788612588.775156:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:2394:x1875495914374272:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612588.775171:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612588.775178:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 17 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.775191:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 17 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.775214:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc88f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222df expref: 17 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.775230:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:3.0:1788612588.775235:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.775245:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.775253:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.775331:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612588.775392:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:2394:x1875495914374272:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 237us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612588.775398:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00010000:00010000:2.0:1788612588.776169:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.776179:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612588.776302:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788612588.776420:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788612588.776455:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788612588.776595:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875495932269952:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788612588.776668:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612588.776693:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612588.777722:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932269952 00000100:00100000:1.0:1788612588.777735:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932269952 00000100:00100000:1.0:1788612588.777794:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788612588.777803:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1875495932269952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788612588.777929:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1875495932269952:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.777936:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788612588.778951:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875495932269952:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788612588.779115:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788612588.779188:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875495932270080:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788612588.779270:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612588.779300:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612588.779503:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932270080 00000100:00100000:1.0:1788612588.779516:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932270080 00000100:00100000:1.0:1788612588.779560:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788612588.779569:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1875495932270080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788612588.779713:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1875495932270080:12345-0@lo:1000:mdt00_000.0 Request processed in 144us (441us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788612588.779719:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612588.780200:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875495932270080:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788612588.780252:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780262:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780270:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780283:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.780288:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780296:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780311:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:2.0:1788612588.780314:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612588.780319:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780325:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37400/0x1f8616bf0bc8944 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780350:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780357:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780377:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780382:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.780385:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780392:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780400:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.780403:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612588.780411:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780422:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780431:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.780461:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.780748:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932270208:192.168.203.30@tcp:105: 00000100:00100000:2.0:1788612588.780831:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c29c4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612588.784005:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932270208:192.168.203.30@tcp:105: 00010000:00010000:2.0:1788612588.784055:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784065:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8887 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784094:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784107:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784119:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784130:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784136:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784143:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784161:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.784165:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784173:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784183:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.784186:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612588.784197:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784204:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc894b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784214:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784220:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784226:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784231:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612588.784233:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784239:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784247:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612588.784249:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612588.784252:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.784258:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc893d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612588.784427:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11387:x1875495914374016:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 22377us (22787us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788612588.784438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000020:00080000:2.0:1788612588.784450:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788612588.784732:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612588.784746:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612588.785268:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788612588.785277:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612588.788028:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.788130:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374400 00000100:00100000:1.0:1788612588.788143:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374400 00000100:00100000:1.0:1788612588.788229:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1788612588.788240:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11386:x1875495914374400:12345-192.168.203.30@tcp:49:lfs.0 00000100:00100000:1.0:1788612588.788669:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11386:x1875495914374400:12345-192.168.203.30@tcp:49:lfs.0 Request processed in 429us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.788693:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1788612588.794908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612588.795003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374656 00000100:00100000:0.0:1788612588.795026:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374656 00000100:00100000:0.0:1788612588.795084:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:0.0:1788612588.795095:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:11387:x1875495914374656:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788612588.795351:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788612588.795379:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788612588.795408:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.795423:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.795434:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.795443:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.795448:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.795455:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612588.795630:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788612588.795717:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:11387:x1875495914374656:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 624us (817us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788612588.795726:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000020:00080000:0.0:1788612588.795730:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788612588.798453:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612588.798689:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.798700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612588.798704:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.798713:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.798730:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:3.0:1788612588.798734:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612588.798747:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.798754:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8952 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612588.798842:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612588.798845:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612588.798847:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612588.799046:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.799384:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374912 00000100:00100000:1.0:1788612588.799393:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374912 00000100:00100000:1.0:1788612588.799650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1788612588.799661:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:11386:x1875495914374912:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1788612588.799842:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788612588.800024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:11386:x1875495914374912:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 364us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.800032:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1788612588.835556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.835717:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375040 00000100:00100000:1.0:1788612588.835727:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375040 00000100:00100000:1.0:1788612588.835803:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1788612588.835813:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:11389:x1875495914375040:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612588.835835:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612588.835857:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8959 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d222fb expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.835916:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.835931:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.835942:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.835958:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.835979:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.835986:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.836062:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.836073:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.836082:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.836116:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.836130:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 22 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612588.836143:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7aca680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932270336:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612588.836230:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612588.840092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612588.840256:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7aca680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932270336:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612588.840295:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612588.840414:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375296 00000100:00100000:0.0:1788612588.840423:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375296 00000100:00100000:0.0:1788612588.840536:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1788612588.840546:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:6163:x1875495914375296:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788612588.840980:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:6163:x1875495914375296:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 433us (895us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788612588.840988:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1788612588.843565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612588.843711:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375424 00000100:00100000:3.0:1788612588.843721:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375424 00010000:00010000:3.0:1788612588.843762:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 24 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612588.843805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:3.0:1788612588.843815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:2394:x1875495914375424:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612588.843844:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612588.843851:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 24 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.843876:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 24 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.843900:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8879 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222bc expref: 24 pid: 12327 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.843917:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:3.0:1788612588.843922:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.843931:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.843939:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612588.843973:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612588.844029:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:2394:x1875495914375424:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 216us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612588.844037:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00010000:00010000:1.0:1788612588.845041:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845064:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612588.845122:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788612588.845126:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612588.845146:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845161:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845170:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845178:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845185:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845190:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.845194:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845201:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845214:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612588.845217:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.845221:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845237:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8960 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845251:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845258:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845263:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845268:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612588.845271:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845286:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845294:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9612c4d8bc00) 00010000:00010000:1.0:1788612588.845296:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612588.845299:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845305:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8967 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845343:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8959 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222fb expref: 23 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845356:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222fb expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612588.845370:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612588.845372:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612588.845375:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a200, rc 0) 00000100:00100000:1.0:1788612588.845435:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11389:x1875495914375040:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 9623us (9889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612588.845444:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00010000:00010000:3.0:1788612588.911697:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612589.748983:0:14314:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612589.748994:0:14314:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612589.749038:0:14314:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788612589.749046:0:14314:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788612589.810704:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612589.810715:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612589.810744:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788612589.810750:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612589.810913:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932270464:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612589.811330:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612589.821628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612589.822713:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932270464:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612589.824956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375552 00000100:00100000:1.0:1788612589.824972:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375552 00000100:00100000:1.0:1788612589.825091:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1788612589.825105:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11402:x1875495914375552:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612589.825139:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612589.825283:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11402:x1875495914375552:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 181us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612589.825290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00080000:2.0:1788612589.828472:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612589.835166:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612589.835236:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375808 00000100:00100000:0.0:1788612589.835246:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375808 00000100:00100000:0.0:1788612589.835315:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:0.0:1788612589.835326:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:11402:x1875495914375808:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612589.835345:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612589.835363:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8975 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22302 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612589.835472:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc897c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612589.835510:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc897c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612589.835524:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc897c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612589.835535:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788612589.835653:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8975 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22302 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612589.835685:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc897c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22302 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612589.835695:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612589.835699:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612589.835702:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897200, rc 0) 00000100:00100000:0.0:1788612589.835776:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:11402:x1875495914375808:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 451us (618us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788612589.835786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:1.0:1788612589.843326:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612589.843427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612589.843652:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376192 00000100:00100000:0.0:1788612589.843663:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376192 00000100:00100000:0.0:1788612589.844631:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788612589.844645:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9283850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:2394:x1875495914376192:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612589.844665:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612589.844689:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc897c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22302 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612589.844709:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:0.0:1788612589.844714:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612589.844770:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9283850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:2394:x1875495914376192:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 131us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612589.844778:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1788612589.845776:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376064 00000100:00100000:3.0:1788612589.845786:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376064 00000100:00100000:3.0:1788612589.845856:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:3.0:1788612589.845865:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:11402:x1875495914376064:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788612589.845932:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.845947:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.845958:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846090:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846097:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846104:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846109:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612589.846113:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846120:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846145:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:3.0:1788612589.846148:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612589.846152:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612589.846157:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc898a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612589.846244:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:11402:x1875495914376064:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 380us (2926us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788612589.846252:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000040:00080000:3.0:1788612589.846341:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612589.846345:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612589.846861:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788612589.846868:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612589.856350:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612589.856804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376448 00000100:00100000:0.0:1788612589.856815:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376448 00000100:00100000:0.0:1788612589.856876:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:0.0:1788612589.856899:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:11402:x1875495914376448:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788612589.857129:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:11402:x1875495914376448:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 232us (789us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788612589.857138:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00010000:00010000:2.0:1788612589.939657:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612590.579714:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612590.579738:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932270592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612590.579806:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612590.581397:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932270592 00000100:00100000:1.0:1788612590.581410:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932270592 00000100:00100000:1.0:1788612590.581512:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788612590.581523:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932270592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612590.581559:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788612590.581647:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932270592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612590.581671:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788612590.581824:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932270592:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612590.959661:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612591.201730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612591.201780:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612591.201805:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612591.201827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612591.201870:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376960 00000100:00100000:3.0:1788612591.201879:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376960 00000100:00100000:3.0:1788612591.201933:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:3.0:1788612591.201942:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914376960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612591.202005:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914376960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612591.202012:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00080000:3.0:1788612591.202032:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612591.202142:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376704 00000100:00100000:0.0:1788612591.202146:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376704 00000100:00100000:0.0:1788612591.202189:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377216 00000100:00100000:0.0:1788612591.202192:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377216 00000100:00100000:0.0:1788612591.202213:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:0.0:1788612591.202220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:2395:x1875495914376704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612591.202256:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:2395:x1875495914376704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612591.202262:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:0.0:1788612591.202275:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:0.0:1788612591.202280:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914377216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612591.202300:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914377216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612591.202305:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00080000:3.0:1788612591.202374:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612591.219891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612591.219930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612591.219963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612591.220002:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376832 00000100:00100000:0.0:1788612591.220011:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376832 00000100:00100000:0.0:1788612591.220063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377344 00000100:00100000:0.0:1788612591.220067:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377344 00000100:00100000:0.0:1788612591.220089:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:0.0:1788612591.220098:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914376832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612591.220169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914376832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612591.220176:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:0.0:1788612591.220193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:0.0:1788612591.220201:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914377344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612591.220227:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914377344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612591.220233:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:0.0:1788612591.220374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376576 00000100:00100000:0.0:1788612591.220379:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376576 00000100:00100000:0.0:1788612591.220406:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 382 00000100:00100000:0.0:1788612591.220412:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914376576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612591.220454:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914376576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (18611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612591.220461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 382 00000100:00080000:3.0:1788612591.220657:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612591.220921:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377088 00000100:00100000:1.0:1788612591.220926:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377088 00000100:00100000:1.0:1788612591.220972:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:1.0:1788612591.220980:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914377088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612591.221012:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914377088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612591.221019:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00080000:3.0:1788612591.221071:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788612591.798793:0:14366:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612591.798803:0:14366:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612591.800023:0:14366:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788612591.800031:0:14366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788612591.989236:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612592.005170:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612592.005371:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377600 00000100:00100000:3.0:1788612592.005380:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377600 00000100:00100000:3.0:1788612592.005437:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:3.0:1788612592.005458:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:11423:x1875495914377600:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612592.005533:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612592.005554:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8991 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22309 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.005652:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8998 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.005667:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8998 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.005678:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8998 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612592.005687:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788612592.006091:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc8991 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22309 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.006108:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8998 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22309 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.006117:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:3.0:1788612592.006119:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788612592.006122:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241600, rc 0) 00000100:00100000:3.0:1788612592.006186:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:11423:x1875495914377600:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 731us (1025us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788612592.006207:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1788612592.012166:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612592.012271:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377728 00000100:00100000:2.0:1788612592.012281:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377728 00000100:00100000:2.0:1788612592.012339:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:2.0:1788612592.012350:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:11423:x1875495914377728:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:2.0:1788612592.012412:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012428:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012439:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012509:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012517:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012525:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012542:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612592.012547:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012555:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012568:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:2.0:1788612592.012571:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612592.012576:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.012582:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc89a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612592.012652:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:11423:x1875495914377728:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 303us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.012660:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:3.0:1788612592.114107:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612592.114131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932270720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612592.114197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612592.114264:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932270720 00000100:00100000:3.0:1788612592.114272:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932270720 00000100:00100000:3.0:1788612592.114324:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788612592.114334:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932270720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612592.114363:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612592.114408:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932270720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612592.114415:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788612592.114436:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612592.114499:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932270720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612592.114894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932270848:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.114930:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.114953:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932271360:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.114978:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.114997:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932271872:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.115038:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788612592.115043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115066:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.115097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932271488:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115118:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.115135:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932272000:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115155:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.115179:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271360 00000100:00100000:2.0:1788612592.115183:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271360 00000100:00100000:2.0:1788612592.115214:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612592.115221:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932271360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115275:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932271360:12345-0@lo:400:kworker.0 Request processed in 54us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.115281:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612592.115301:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932270976 00000100:00100000:2.0:1788612592.115305:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932270976 00000100:00100000:2.0:1788612592.115326:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271488 00000100:00100000:2.0:1788612592.115329:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271488 00000100:00100000:2.0:1788612592.115348:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272000 00000100:00100000:2.0:1788612592.115351:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272000 00000100:00100000:2.0:1788612592.115365:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788612592.115370:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932270976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115399:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932270976:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.115404:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788612592.115416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788612592.115423:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932271488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932271488:12345-0@lo:400:kworker.0 Request processed in 38us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.115467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788612592.115515:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788612592.115522:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932272000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115549:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932272000:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.115555:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788612592.115585:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115594:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932271488:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115603:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932272000:0@lo:400:kworker.0 00000100:00100000:2.0:1788612592.115612:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932271360:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.115851:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932271232:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.115883:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.115903:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932271744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.115925:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.115944:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932272256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.115963:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.115982:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788612592.115988:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932271104:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116009:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.116024:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932271616:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116044:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.116056:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932272128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116076:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.116214:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932270848 00000100:00100000:0.0:1788612592.116218:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932270848 00000100:00100000:0.0:1788612592.116263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788612592.116271:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932270848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116312:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e8d96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932270848:12345-0@lo:400:kworker.0 Request processed in 42us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116318:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788612592.116345:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271232 00000100:00100000:0.0:1788612592.116348:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271232 00000100:00100000:0.0:1788612592.116365:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271616 00000100:00100000:0.0:1788612592.116367:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271616 00000100:00100000:0.0:1788612592.116380:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272128 00000100:00100000:0.0:1788612592.116383:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272128 00000100:00100000:0.0:1788612592.116395:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788612592.116410:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932271232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116457:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932271232:12345-0@lo:400:kworker.0 Request processed in 47us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116463:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788612592.116502:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788612592.116509:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932271616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116538:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932271616:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116544:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788612592.116555:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788612592.116561:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932272128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116588:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932272128:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116594:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788612592.116612:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271872 00000100:00100000:0.0:1788612592.116615:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271872 00000100:00100000:0.0:1788612592.116640:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271744 00000100:00100000:0.0:1788612592.116643:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271744 00000100:00100000:0.0:1788612592.116653:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272256 00000100:00100000:0.0:1788612592.116655:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272256 00000100:00100000:0.0:1788612592.116665:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612592.116670:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875495932271872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116699:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875495932271872:12345-0@lo:400:kworker.0 Request processed in 29us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116704:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612592.116715:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612592.116720:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932271744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116754:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932271744:12345-0@lo:400:kworker.0 Request processed in 34us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116760:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612592.116772:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788612592.116778:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875495932272256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.116805:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875495932272256:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.116811:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1788612592.117008:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961301762300 x1875495932271616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612592.117020:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932271616:0@lo:400:kworker.0 00010000:00080000:0.0:1788612592.117031:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c6ad9500 x1875495932272128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612592.117039:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932272128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117050:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932271232:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117058:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932271744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117067:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932272256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117101:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932271104 00000100:00100000:0.0:1788612592.117104:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932271104 00000100:00100000:0.0:1788612592.117124:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788612592.117130:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932271104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117168:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932271104:12345-0@lo:400:kworker.0 Request processed in 38us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.117184:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788612592.117211:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932271104:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117240:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932270848:0@lo:400:kworker.0 00000100:00100000:0.0:1788612592.117252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932271872:0@lo:400:kworker.0 00000100:00100000:3.0:1788612592.119610:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612592.119636:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932272384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612592.119705:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.123385:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272384 00000100:00100000:2.0:1788612592.123400:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272384 00000100:00100000:2.0:1788612592.123488:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788612592.123500:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932272384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612592.123526:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612592.123610:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932272384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (3904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.123619:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788612592.125702:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612592.125711:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612592.125715:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612592.125718:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612592.125789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932272384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612592.151268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612592.151605:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377856 00000100:00100000:3.0:1788612592.151614:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377856 00000100:00100000:3.0:1788612592.151697:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612592.151707:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914377856:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1788612592.151725:0:8543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612592.151759:0:8543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc89ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22310 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612592.151783:0:8543:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c0fec, atime: 0x6a9c0feb, ctime: 0x6a9c0fec, blocks: 0x8 00010000:00010000:3.0:1788612592.151811:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1788612592.151815:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612592.151824:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc89ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22310 expref: 7 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.151855:0:8543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc89ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22310 expref: 7 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.151869:0:8543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241e00, rc 0) 00000100:00100000:3.0:1788612592.151924:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2397:x1875495914377856:12345-192.168.203.30@tcp:101:cat.0 Request processed in 218us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612592.151931:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1788612592.157001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612592.157076:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377984 00000100:00100000:3.0:1788612592.157086:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377984 00002000:00100000:3.0:1788612592.157131:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9612c12af100 x1875495914377984/t0(0) o3->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:238/0 lens 488/0 e 0 to 0 dl 1788612603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612592.157142:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9612c12af100 with x1875495914377984 ext(0->4095) 00002000:00010000:3.0:1788612592.157149:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9612c12af100 00000100:00100000:3.0:1788612592.157183:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1788612592.157192:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914377984:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:3.0:1788612592.157680:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914377984:12345-192.168.203.30@tcp:3:cat.0 Request processed in 486us (686us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788612592.157689:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:3.0:1788612592.157697:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9612c12af100 x1875495914377984/t0(0) o3->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:238/0 lens 488/4536 e 0 to 0 dl 1788612603 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612592.157723:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9612c12af100 with x1875495914377984 ext(0->4095) 00002000:00010000:3.0:1788612592.157727:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9612c12af100 00000004:00080000:2.0:1788612592.623699:0:8540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407007220175ns, next at 408007217638ns, rc = 0 00000100:00100000:0.0:1788612592.623791:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932272512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612592.623857:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612592.623979:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272512 00000100:00100000:2.0:1788612592.623987:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272512 00000100:00100000:2.0:1788612592.624040:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788612592.624050:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932272512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612592.624079:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788612592.624138:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932272512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612592.624145:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788612592.624226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932272512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612592.625618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932272640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612592.625670:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612592.625769:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272640 00000100:00100000:3.0:1788612592.625777:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272640 00000100:00100000:3.0:1788612592.625821:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612592.625830:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932272640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612592.625858:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788612592.625900:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932272640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612592.625906:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612592.625941:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932272640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612592.626920:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932272768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612592.626963:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612592.627106:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272768 00000100:00100000:0.0:1788612592.627113:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272768 00000100:00100000:0.0:1788612592.627158:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788612592.627166:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932272768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612592.627185:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788612592.627238:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932272768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612592.627245:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788612592.627364:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932272768:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612593.007672:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612593.392424:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788612593.658002:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788612593.658019:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1788612593.967656:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612593.967666:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612593.967687:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788612593.967709:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788612594.035223:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788612594.674527:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1788612594.674577:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788612594.674600:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9612fccdb480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788612594.674606:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fe8e1700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9612fccdbd80 00000020:00080000:3.0:1788612594.674609:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fe8e1c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9612e2178000 00000020:00080000:3.0:1788612594.674628:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788612594.674640:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788612594.674704:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788612594.674783:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612594.674795:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612594.674803:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612594.674809:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612594.674814:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612594.674822:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612594.674839:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9612c4d8a700) 00010000:00010000:0.0:1788612594.674842:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612594.674847:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612594.674852:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8928 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612594.675808:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788612594.675819:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:0.0:1788612594.675990:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932272896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788612594.676058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612594.676171:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932272896 00000100:00100000:2.0:1788612594.676179:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932272896 00000100:00080000:0.0:1788612594.676307:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612594.676412:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788612594.676434:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932272896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788612594.676581:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788612594.676585:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788612588 -> 1788612588 00002000:00010000:2.0:1788612594.676587:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788612587 -> 1788612587 00002000:00010000:2.0:1788612594.676589:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788612588 -> 1788612588 00002000:00010000:2.0:1788612594.676591:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788612594.676634:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932272896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (576us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788612594.676641:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612594.676735:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788612594.676741:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c815ed80, transno 4294967310 00000004:00080000:0.0:1788612594.676760:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788612594.676780:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9611c6ad8000 x1875495932272896/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788612610 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788612594.676792:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c6ad8000/2, rc 0, transno 4294967313 00000100:00100000:0.0:1788612594.676796:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932272896:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788612595.067467:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612595.695660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612595.700930:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932273024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612595.701009:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612595.701141:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273024 00000100:00100000:2.0:1788612595.701151:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273024 00000100:00100000:2.0:1788612595.701208:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788612595.701218:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932273024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612595.701265:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788612595.701319:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932273024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612595.701326:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788612595.701427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932273024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788612596.081780:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612596.318456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318605:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318627:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318652:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612596.318682:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378368 00000100:00100000:3.0:1788612596.318691:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378368 00000100:00100000:3.0:1788612596.318746:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378880 00000100:00100000:3.0:1788612596.318750:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378880 00000100:00100000:3.0:1788612596.318763:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378240 00000100:00100000:3.0:1788612596.318765:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378240 00000100:00100000:3.0:1788612596.318777:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378752 00000100:00100000:3.0:1788612596.318779:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378752 00000100:00100000:3.0:1788612596.318794:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:3.0:1788612596.318802:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914378368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612596.318972:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 303 00000100:00100000:1.0:1788612596.318982:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914378880:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612596.319053:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914378880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 73us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612596.319060:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 303 00000100:00100000:1.0:1788612596.319079:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:1.0:1788612596.319085:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:2397:x1875495914378240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612596.319126:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:2397:x1875495914378240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612596.319133:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:1.0:1788612596.319149:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 305 00000100:00100000:1.0:1788612596.319155:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914378752:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612596.319181:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2397:x1875495914378752:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612596.319187:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 305 00000100:00100000:2.0:1788612596.319681:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378624 00000100:00100000:2.0:1788612596.319687:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378624 00000100:00100000:2.0:1788612596.319731:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378496 00000100:00100000:2.0:1788612596.319734:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378496 00000100:00100000:2.0:1788612596.319760:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1788612596.319768:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914378624:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612596.319805:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914378624:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612596.319822:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1788612596.319838:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:2.0:1788612596.319844:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914378496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612596.319868:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2397:x1875495914378496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612596.319874:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00080000:2.0:1788612596.319949:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612596.319954:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612596.319957:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612596.319959:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612596.320429:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2397:x1875495914378368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1610us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612596.320438:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:0.0:1788612596.322814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378112 00000100:00100000:0.0:1788612596.322827:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378112 00000100:00100000:0.0:1788612596.322890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 384 00000100:00100000:0.0:1788612596.322900:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914378112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612596.322968:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2397:x1875495914378112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612596.322976:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 384 00010000:00010000:3.0:1788612597.104674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612597.231869:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932273408:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.231939:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612597.231998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932273920:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.232033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612597.232063:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932274432:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.232084:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612597.232108:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612597.232114:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932273536:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.232134:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232546:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932273152:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232586:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232611:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932273664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232633:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232649:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932274176:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232668:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932274688:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232698:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232715:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612597.232721:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932273280:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232741:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232757:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932273792:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232775:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232790:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932274304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.232829:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612597.232926:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273408 00000100:00100000:1.0:1788612597.232933:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273408 00000100:00100000:1.0:1788612597.232964:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273664 00000100:00100000:1.0:1788612597.232967:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273664 00000100:00100000:1.0:1788612597.232980:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788612597.232987:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932273408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.233031:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932273408:12345-0@lo:400:kworker.0 Request processed in 44us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612597.233038:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788612597.233052:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788612597.233058:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932273664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.233086:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932273664:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612597.233092:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788612597.233108:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274176 00000100:00100000:1.0:1788612597.233111:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274176 00000100:00100000:1.0:1788612597.233142:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274688 00000100:00100000:1.0:1788612597.233145:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274688 00000100:00100000:1.0:1788612597.233162:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788612597.233168:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932274176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.233198:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932274176:12345-0@lo:400:kworker.0 Request processed in 30us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612597.233204:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788612597.233215:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788612597.233221:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932274688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273920 00000100:00100000:2.0:1788612597.233368:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273920 00000100:00100000:2.0:1788612597.233391:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274432 00000100:00100000:2.0:1788612597.233394:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274432 00000100:00100000:2.0:1788612597.233414:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273536 00000100:00100000:2.0:1788612597.233418:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273536 00000100:00100000:2.0:1788612597.233429:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273280 00000100:00100000:2.0:1788612597.233432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273280 00000100:00100000:2.0:1788612597.233441:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273792 00000100:00100000:2.0:1788612597.233443:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273792 00000100:00100000:2.0:1788612597.233466:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274304 00000100:00100000:2.0:1788612597.233468:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274304 00000100:00100000:2.0:1788612597.233506:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788612597.233513:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932273920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233547:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932273920:12345-0@lo:400:kworker.0 Request processed in 35us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.233552:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788612597.233566:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788612597.233572:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932274432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233599:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932274432:12345-0@lo:400:kworker.0 Request processed in 27us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.233605:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788612597.233615:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788612597.233621:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932273536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233644:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932273536:12345-0@lo:400:kworker.0 Request processed in 24us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.233649:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788612597.233659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788612597.233664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932273280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233689:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932273280:12345-0@lo:400:kworker.0 Request processed in 25us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.233695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788612597.233705:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788612597.233710:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932273792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233733:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932273792:12345-0@lo:400:kworker.0 Request processed in 22us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.233744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788612597.233756:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788612597.233761:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932274304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612597.233788:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932274304:12345-0@lo:400:kworker.0 Request processed in 27us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.233794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788612597.234017:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932274688:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612597.234045:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788612597.234069:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612597.234073:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612597.234075:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612597.234077:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612597.234113:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932273280:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.234125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932273792:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.234148:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932274304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.234159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932273664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.234170:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932274176:0@lo:400:kworker.0 00000100:00100000:1.0:1788612597.234178:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788612597.234183:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788612597.234201:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961301763b80, transno 4294967305 00000100:00100000:1.0:1788612597.234220:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932274688:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932273536:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932274048:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234401:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612597.234441:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932274560:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234463:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612597.234498:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932273408:0@lo:400:kworker.0 00010000:00080000:0.0:1788612597.234510:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961301806680 x1875495932273920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612597.234519:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932273920:0@lo:400:kworker.0 00010000:00080000:0.0:1788612597.234529:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f6680 x1875495932274432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612597.234537:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932274432:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234579:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932273152 00000100:00100000:0.0:1788612597.234582:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932273152 00000100:00100000:0.0:1788612597.234610:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788612597.234616:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932273152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234651:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932273152:12345-0@lo:400:kworker.0 Request processed in 35us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612597.234656:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788612597.234685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932273152:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234712:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274048 00000100:00100000:0.0:1788612597.234714:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274048 00000100:00100000:0.0:1788612597.234733:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274560 00000100:00100000:0.0:1788612597.234736:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274560 00000100:00100000:0.0:1788612597.234749:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612597.234753:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234795:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932274048:12345-0@lo:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612597.234813:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612597.234825:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788612597.234831:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932274560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234873:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932274560:12345-0@lo:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612597.234879:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788612597.234902:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932274048:0@lo:400:kworker.0 00000100:00100000:0.0:1788612597.234910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932274560:0@lo:400:kworker.0 00000100:00080000:0.0:1788612597.234940:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612597.234943:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612597.236183:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612597.236356:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612597.236452:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274816 00000100:00100000:3.0:1788612597.236459:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274816 00000100:00100000:3.0:1788612597.236559:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788612597.236568:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932274816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612597.236591:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612597.236634:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932274816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612597.236651:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788612597.236693:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612597.236892:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932274944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612597.236920:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612597.236973:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932274944 00000100:00100000:3.0:1788612597.236978:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932274944 00000100:00100000:3.0:1788612597.237008:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788612597.237014:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932274944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612597.237035:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612597.237362:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932274944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 346us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612597.237369:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788612597.237431:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932274944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612597.744834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932275072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612597.744905:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612597.744993:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275072 00000100:00100000:2.0:1788612597.745001:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275072 00000100:00100000:2.0:1788612597.745048:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788612597.745057:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932275072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612597.745083:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788612597.745127:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932275072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.745134:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788612597.745181:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932275072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612597.745774:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612597.745784:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932275200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612597.745824:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612597.745857:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275200 00000100:00100000:2.0:1788612597.745862:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275200 00000100:00100000:2.0:1788612597.745889:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788612597.745896:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932275200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612597.745908:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788612597.745955:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932275200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.745961:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788612597.745991:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932275200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612597.748977:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612597.748999:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932275328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612597.749064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612597.749116:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275328 00000100:00100000:2.0:1788612597.749122:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275328 00000100:00100000:2.0:1788612597.749162:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788612597.749172:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932275328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612597.749203:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612597.749247:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932275328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612597.749254:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788612597.749295:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932275328:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788612598.129156:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612598.378620:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612598.378915:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379008 00000100:00100000:0.0:1788612598.378927:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379008 00000100:00100000:0.0:1788612598.379015:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:0.0:1788612598.379026:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11067:x1875495914379008:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788612598.379130:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11067:x1875495914379008:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 106us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612598.379137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00080000:1.0:1788612598.379263:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612598.382707:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612598.382882:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379136 00000100:00100000:1.0:1788612598.382892:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379136 00000100:00100000:1.0:1788612598.382983:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:1.0:1788612598.382994:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:11067:x1875495914379136:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788612598.383103:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:11067:x1875495914379136:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 111us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612598.383111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00080000:0.0:1788612598.384034:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612598.388005:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612598.388103:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379392 00000100:00100000:1.0:1788612598.388113:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379392 00000100:00100000:1.0:1788612598.388185:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:1.0:1788612598.388194:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:11067:x1875495914379392:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788612598.388419:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:11067:x1875495914379392:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 226us (423us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788612598.388427:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1788612598.759452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612598.759661:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379520 00000100:00100000:0.0:1788612598.759672:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379520 00000100:00100000:0.0:1788612598.759810:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:0.0:1788612598.759820:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:11881:x1875495914379520:12345-192.168.203.30@tcp:101:lsof.0 00010000:00010000:0.0:1788612598.759847:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612598.759873:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22317 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612598.759948:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612598.759962:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612598.759975:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612598.760016:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612598.760020:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612598.760053:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612598.760072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612598.760088:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612598.760096:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:0.0:1788612598.760099:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612598.760103:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896600, rc 0) 00000100:00100000:0.0:1788612598.760163:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:11881:x1875495914379520:12345-192.168.203.30@tcp:101:lsof.0 Request processed in 345us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612598.760170:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00080000:1.0:1788612598.762674:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612599.153737:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612600.175785:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612600.816050:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612600.816074:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932275456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612600.816139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612600.816248:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275456 00000100:00100000:3.0:1788612600.816256:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275456 00000100:00100000:3.0:1788612600.816296:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788612600.816304:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932275456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612600.816335:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788612600.816376:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932275456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612600.816436:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788612600.816611:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932275456:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788612600.824515:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788612600.824531:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788612600.824679:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788612600.824691:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1788612600.824905:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:3.0:1788612601.201531:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612601.439579:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612601.439610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612601.439744:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379904 00000100:00100000:1.0:1788612601.439752:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379904 00000100:00100000:1.0:1788612601.439807:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:1.0:1788612601.439815:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914379904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612601.439881:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914379904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612601.439888:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:2.0:1788612601.440199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612601.440240:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612601.440258:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612601.440291:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612601.440312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612601.440330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380416 00000100:00100000:2.0:1788612601.440333:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380416 00000100:00100000:2.0:1788612601.440357:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379776 00000100:00100000:2.0:1788612601.440359:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379776 00000100:00100000:2.0:1788612601.440371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380288 00000100:00100000:2.0:1788612601.440373:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380288 00000100:00100000:2.0:1788612601.440397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 313 00000100:00100000:2.0:1788612601.440403:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914380416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612601.440433:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914380416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612601.440439:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 313 00000100:00100000:2.0:1788612601.440451:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 314 00000100:00100000:2.0:1788612601.440456:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:2395:x1875495914379776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612601.440497:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:2395:x1875495914379776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612601.440503:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 314 00000100:00100000:2.0:1788612601.440513:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 315 00000100:00100000:2.0:1788612601.440519:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2395:x1875495914380288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612601.440536:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+6:2395:x1875495914380288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612601.440547:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 315 00000100:00100000:1.0:1788612601.440825:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380160 00000100:00100000:1.0:1788612601.440829:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380160 00000100:00100000:1.0:1788612601.440852:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380032 00000100:00100000:1.0:1788612601.440854:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380032 00000100:00100000:1.0:1788612601.440868:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1788612601.440874:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914380160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612601.440935:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:0.0:1788612601.440943:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914380032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612601.441130:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379648 00000100:00100000:3.0:1788612601.441134:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379648 00000100:00100000:3.0:1788612601.441221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 386 00000100:00100000:3.0:1788612601.441229:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914379648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612601.442346:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914380160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1467us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612601.442368:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00080000:1.0:1788612601.442436:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612601.442440:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612601.442443:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612601.442445:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612601.446112:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914380032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 5159us (5809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612601.446127:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:3.0:1788612601.447268:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914379648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 6033us (7690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612601.447282:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 386 00010000:00010000:0.0:1788612602.223996:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612602.352234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932275584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612602.352328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612602.352452:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275584 00000100:00100000:0.0:1788612602.352462:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275584 00000100:00100000:3.0:1788612602.352657:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612602.352725:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.352873:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275712 00000100:00100000:3.0:1788612602.352881:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275712 00000100:00100000:1.0:1788612602.352901:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788612602.352919:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932275584:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612602.352939:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612602.352953:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932275712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612602.352973:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788612602.352976:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612602.353062:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932275712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612602.353078:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932275584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.353079:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788612602.353093:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788612602.353136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612602.353161:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612602.353186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932275584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612602.353761:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932275840:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.353800:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.353826:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932276352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.353974:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.353996:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932276864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354020:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.354046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788612602.354054:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932276224:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354096:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.354120:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932276736:0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.354132:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276224 00000100:00100000:2.0:1788612602.354141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276224 00000100:00100000:3.0:1788612602.354148:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612602.354196:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788612602.354207:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932276224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.354268:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932276224:12345-0@lo:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612602.354275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788612602.354515:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932276224:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275840 00000100:00100000:3.0:1788612602.354555:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275840 00000100:00100000:3.0:1788612602.354588:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788612602.354596:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932275840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354636:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932275840:12345-0@lo:400:kworker.0 Request processed in 40us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.354642:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788612602.354668:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276352 00000100:00100000:3.0:1788612602.354671:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276352 00000100:00100000:3.0:1788612602.354692:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788612602.354698:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932276352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354730:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932276352:12345-0@lo:400:kworker.0 Request processed in 32us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.354736:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788612602.354758:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276864 00000100:00100000:3.0:1788612602.354762:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276864 00000100:00100000:3.0:1788612602.354798:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276736 00000100:00100000:3.0:1788612602.354801:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276736 00000100:00100000:3.0:1788612602.354819:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788612602.354824:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932276864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354852:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932276864:12345-0@lo:400:kworker.0 Request processed in 28us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.354869:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788612602.354880:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788612602.354888:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932276736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354928:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932276736:12345-0@lo:400:kworker.0 Request processed in 41us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.354935:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788612602.354968:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932276736:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932275840:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354985:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932276352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.354993:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788612602.354998:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c6ad8000, transno 4294967313 00000100:00100000:3.0:1788612602.355014:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932276864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.355052:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932275968:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.355080:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.355098:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932276480:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.355121:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.355142:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932276992:0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.355165:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612602.355226:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612602.355246:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932275968 00000100:00100000:3.0:1788612602.355252:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788612602.355253:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932275968 00000100:00100000:2.0:1788612602.355297:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276480 00000100:00100000:2.0:1788612602.355301:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276480 00000100:00100000:3.0:1788612602.355325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932276096:0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.355330:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276992 00000100:00100000:2.0:1788612602.355336:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276992 00000100:00100000:2.0:1788612602.355368:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788612602.355387:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932275968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.355432:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612602.355446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932275968:12345-0@lo:400:kworker.0 Request processed in 58us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612602.355456:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788612602.355467:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932276608:0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.355509:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788612602.355521:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932276480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612602.355694:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788612602.355705:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932276992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.355925:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932276480:12345-0@lo:400:kworker.0 Request processed in 406us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612602.355937:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788612602.355943:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.355970:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932277120:0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.355973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276608 00000100:00100000:2.0:1788612602.355980:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276608 00000100:00100000:3.0:1788612602.356000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612602.356020:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932277120 00000100:00100000:2.0:1788612602.356027:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932277120 00000100:00100000:3.0:1788612602.356032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932275968:0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.356054:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788612602.356057:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932276480:0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.356069:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932276608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.356107:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788612602.356120:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932277120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612602.356131:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932276608:12345-0@lo:400:kworker.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612602.356141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00080000:2.0:1788612602.356200:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c8101880 x1875495932276608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612602.356215:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932276608:0@lo:400:kworker.0 00010000:00080000:2.0:1788612602.356230:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c8103480 x1875495932277120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612602.356239:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932277120:12345-0@lo:400:kworker.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612602.356239:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932277120:0@lo:400:kworker.0 00000100:00080000:2.0:1788612602.356269:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612602.356272:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612602.356314:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788612602.356348:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932276096 00000100:00100000:3.0:1788612602.356353:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932276096 00000100:00100000:3.0:1788612602.356402:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788612602.356408:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932276096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612602.356447:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932276096:12345-0@lo:400:kworker.0 Request processed in 39us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.356453:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788612602.356502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788612602.368411:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932276992:12345-0@lo:400:kworker.0 Request processed in 12691us (13227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612602.368430:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788612602.369014:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932276992:0@lo:400:kworker.0 00000001:02000400:2.0:1788612602.602265:0:14563:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:50:00 (1788612600) 00000100:00100000:1.0:1788612602.863810:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932277376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612602.864087:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612602.864231:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932277376 00000100:00100000:0.0:1788612602.864242:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932277376 00000100:00100000:0.0:1788612602.864306:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788612602.864318:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932277376:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612602.864353:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:0.0:1788612602.864357:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788612602.864364:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932277248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612602.864414:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612602.864422:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932277376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612602.864429:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788612602.864463:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932277376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612602.864518:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932277248 00000100:00100000:2.0:1788612602.864522:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932277248 00000100:00100000:2.0:1788612602.864555:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788612602.864562:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932277248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612602.864589:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612602.864647:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932277248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612602.864654:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788612602.864813:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612602.864824:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932277504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612602.864857:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612602.864885:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932277504 00000100:00100000:3.0:1788612602.864889:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932277504 00000100:00100000:3.0:1788612602.864922:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788612602.864929:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932277504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612602.864947:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788612602.864980:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932277504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612602.864987:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788612602.865018:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932277504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612602.865362:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932277248:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788612603.185706:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612603.185719:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612603.185864:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788612603.185871:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788612603.248236:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612603.632608:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612604.162797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612604.166370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380672 00000100:00100000:0.0:1788612604.166395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380672 00000100:00100000:0.0:1788612604.166616:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:0.0:1788612604.166633:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:12148:x1875495914380672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612604.166680:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612604.166709:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc89c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2231e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166808:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166828:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166844:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166861:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166868:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166875:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.166995:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167005:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167012:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612604.167023:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788612604.167153:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167162:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167177:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167183:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612604.167188:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167197:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167211:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9611c76e7200) 00010000:00010000:0.0:1788612604.167215:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612604.167220:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167227:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc89c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167244:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167250:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167255:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167260:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612604.167270:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167276:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167285:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9611c67a4b00) 00010000:00010000:0.0:1788612604.167288:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612604.167291:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167297:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc89d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167762:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc89c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2231e expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167783:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2231e expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612604.167792:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:0.0:1788612604.167794:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612604.167797:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897800, rc 0) 00000100:00100000:0.0:1788612604.167901:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:12148:x1875495914380672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1273us (5120us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788612604.167910:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00080000:2.0:1788612604.171376:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612604.181430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612604.182144:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380800 00000100:00100000:3.0:1788612604.182160:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380800 00000100:00100000:3.0:1788612604.182397:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:3.0:1788612604.182409:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:12148:x1875495914380800:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788612604.182607:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:12148:x1875495914380800:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 199us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612604.182615:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:0.0:1788612604.185800:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612604.185939:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380928 00000100:00100000:2.0:1788612604.185950:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380928 00000100:00080000:0.0:1788612604.186117:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612604.186153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:2.0:1788612604.186165:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:12148:x1875495914380928:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788612604.186434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:12148:x1875495914380928:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 270us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612604.186442:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:2.0:1788612604.190340:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612604.193455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381056 00000100:00100000:3.0:1788612604.193489:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381056 00000100:00100000:3.0:1788612604.193599:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1788612604.193613:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:2396:x1875495914381056:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612604.193634:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612604.193668:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc89d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2231e expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612604.193695:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:3.0:1788612604.193703:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612604.193990:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:2396:x1875495914381056:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 196us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612604.194240:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000040:00080000:1.0:1788612604.208551:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612604.208563:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612604.209928:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788612604.209951:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788612604.272582:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612604.656149:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612605.297554:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612605.941649:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932277632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612605.941717:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612605.941817:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932277632 00000100:00100000:0.0:1788612605.941826:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932277632 00000100:00100000:0.0:1788612605.941879:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788612605.941888:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932277632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612605.941920:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788612605.941971:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932277632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612605.941978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788612605.942092:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c810bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932277632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612606.129928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.130061:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381184 00000100:00100000:3.0:1788612606.130070:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381184 00000100:00100000:3.0:1788612606.130138:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:3.0:1788612606.130149:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:12191:x1875495914381184:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612606.130177:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612606.130198:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22325 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130260:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130274:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130287:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130300:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130307:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130314:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130370:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130390:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130397:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130403:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612606.130408:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130415:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130426:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:3.0:1788612606.130429:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612606.130435:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130441:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc89ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130452:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130458:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130464:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130469:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612606.130507:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130514:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130523:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9611c76e6700) 00010000:00010000:3.0:1788612606.130526:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612606.130528:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130534:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc89f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130569:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22325 expref: 15 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130578:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:3.0:1788612606.130581:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612606.130584:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22325 expref: 15 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.130593:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241800, rc 0) 00000100:00100000:3.0:1788612606.130651:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:12191:x1875495914381184:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 504us (734us total) trans 0 rc 301/301 00000100:00100000:3.0:1788612606.130658:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00080000:0.0:1788612606.131613:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612606.142060:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.142137:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381440 00000100:00100000:3.0:1788612606.142147:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381440 00000100:00100000:3.0:1788612606.142221:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:3.0:1788612606.142231:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:12191:x1875495914381440:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788612606.142290:0:12327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612606.142315:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4200/0x1f8616bf0bc8339 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22149 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.142334:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:3.0:1788612606.142340:0:12327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612606.142402:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.142417:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.142427:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.142460:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.142502:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 5 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612606.142518:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8100e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932277760:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612606.142598:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612606.145667:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612606.146363:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381568 00000100:00100000:0.0:1788612606.146374:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381568 00010000:00010000:0.0:1788612606.146428:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 6 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612606.146466:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:0.0:1788612606.146498:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8103800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:449720ee-67e1-48cb-85d0-ee79593410d8+6:2395:x1875495914381568:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612606.146513:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612606.146522:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 6 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.146535:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 6 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.146556:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:0.0:1788612606.146569:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.146578:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.146585:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.146604:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612606.146652:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8103800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:449720ee-67e1-48cb-85d0-ee79593410d8+6:2395:x1875495914381568:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 178us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612606.146659:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00080000:2.0:1788612606.146943:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612606.149637:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc89bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22317 expref: 5 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.149661:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8100e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932277760:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612606.149685:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.149694:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.149701:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.149726:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.150229:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.150246:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151138:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151153:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151849:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612606.151869:0:12327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000592971fc reply state 00000000a94443d0 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151880:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151888:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612606.151890:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612606.151894:0:12327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788612606.151899:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788612606.151908:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151914:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151921:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151927:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.151931:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151939:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151949:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9611c76e6000) 00010000:00010000:1.0:1788612606.151952:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612606.151962:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151968:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc89fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612606.151990:0:12327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000592971fc reply state 00000000a94443d0 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.151998:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.152004:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9612c4d8be00) 00010000:00010000:1.0:1788612606.152006:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612606.152008:0:12327:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788612606.152144:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:12191:x1875495914381440:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 9912us (10091us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788612606.152153:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:3.0:1788612606.243559:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.243752:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381696 00000100:00100000:1.0:1788612606.243761:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381696 00000100:00100000:1.0:1788612606.243820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:1.0:1788612606.243830:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+15:12199:x1875495914381696:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:1.0:1788612606.243855:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612606.243880:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8a0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2232c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.243943:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc8a16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.243957:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc8a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.243987:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc8a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612606.244029:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612606.244033:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612606.244054:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc8a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.244076:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8a0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2232c expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.244093:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc8a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2232c expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.244100:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:1.0:1788612606.244103:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612606.244106:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ac00, rc 0) 00000100:00100000:1.0:1788612606.244261:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:12199:x1875495914381696:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 432us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.244269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 155 00010000:00010000:0.0:1788612606.319743:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612606.329119:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.329400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381824 00000100:00100000:1.0:1788612606.329410:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381824 00000100:00100000:1.0:1788612606.329472:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:1.0:1788612606.329521:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+16:12205:x1875495914381824:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612606.329541:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612606.329562:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8a1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22333 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329645:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329659:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329671:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329683:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329689:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329695:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329773:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc8a32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329782:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc8a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329789:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc8a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612606.329823:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788612606.329827:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612606.329848:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc8a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329871:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329878:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.329884:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330320:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799be00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.330325:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330333:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330354:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:1.0:1788612606.330358:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612606.330362:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330368:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330384:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330390:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330396:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330408:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.330411:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330417:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330424:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9612c4d8be00) 00010000:00010000:1.0:1788612606.330427:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612606.330429:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330435:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330464:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8a1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22333 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330531:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc8a32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22333 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.330539:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612606.330541:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788612606.330543:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799bc00, rc 0) 00000100:00100000:1.0:1788612606.330603:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:12205:x1875495914381824:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1083us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.330611:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:1.0:1788612606.334067:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.334289:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382080 00000100:00100000:3.0:1788612606.334298:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382080 00000100:00100000:2.0:1788612606.334448:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:2.0:1788612606.334458:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:12205:x1875495914382080:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612606.334498:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612606.334520:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8a39 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2233a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.334621:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.334636:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.334660:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.334716:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.334725:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.334732:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612606.336144:0:12327:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788612606.336778:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336794:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336805:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336837:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336844:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336850:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336856:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612606.336873:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336881:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336906:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:2.0:1788612606.336910:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612606.336914:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336921:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612606.336936:0:12327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df4e7fed reply state 000000002ce62672 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336948:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.336954:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c93f7000) 00010000:00010000:2.0:1788612606.336956:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612606.336959:0:12327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788612606.336995:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8a39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 20 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.337010:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 19 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.337016:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612606.337018:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612606.337027:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37c00, rc 0) 00000100:00100000:2.0:1788612606.337100:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12205:x1875495914382080:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2641us (3042us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788612606.337109:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:2.0:1788612606.340903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.340981:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382208 00000100:00100000:3.0:1788612606.340990:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382208 00000100:00100000:3.0:1788612606.341060:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1788612606.341070:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914382208:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612606.341086:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612606.341105:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22341 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612606.341131:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612606.341148:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788612606.341153:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612606.341170:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.341189:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 6 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.341202:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241400, rc 0) 00000100:00100000:3.0:1788612606.341270:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914382208:12345-192.168.203.30@tcp:101:bash.0 Request processed in 201us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612606.341278:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00080000:2.0:1788612606.341755:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612606.344103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.344336:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382336 00000100:00100000:1.0:1788612606.344354:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382336 00000100:00100000:1.0:1788612606.344405:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1788612606.344415:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:12205:x1875495914382336:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612606.344431:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612606.344449:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22348 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.344525:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.344535:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612606.344539:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612606.344545:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.344579:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.344593:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 7 pid: 8441 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.344608:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875495932277888:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612606.344706:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612606.349573:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612606.349624:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382464 00000100:00100000:2.0:1788612606.349636:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382464 00010000:00010000:2.0:1788612606.349679:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 8 pid: 8441 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612606.349725:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1788612606.349824:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914382464:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612606.349841:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612606.349863:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 8 pid: 8441 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.349877:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 8 pid: 8441 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.349916:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612606.349921:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612606.349930:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.349941:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.349960:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc8a5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22341 expref: 8 pid: 8441 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.349992:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875495932277888:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612606.349996:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612606.350012:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8109f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1875495932278016:192.168.203.30@tcp:105: 00010000:00010000:1.0:1788612606.350020:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.350032:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a000, rc 0) 00000100:00100000:1.0:1788612606.350075:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:12205:x1875495914382336:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5661us (5980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.350083:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1788612606.350084:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612606.354445:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.354561:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382720 00000100:00100000:1.0:1788612606.354568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382720 00000100:00100000:0.0:1788612606.354580:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8109f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1875495932278016:192.168.203.30@tcp:105: 00010000:00010000:0.0:1788612606.354604:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612606.354619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1788612606.354629:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12205:x1875495914382720:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:0.0:1788612606.354665:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914382464:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 4930us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612606.354673:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:1.0:1788612606.354901:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12205:x1875495914382720:12345-192.168.203.30@tcp:35:bash.0 Request processed in 272us (465us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788612606.354909:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:2.0:1788612606.440374:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.440523:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382976 00000100:00100000:3.0:1788612606.440534:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382976 00000100:00100000:3.0:1788612606.440600:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:3.0:1788612606.440611:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12215:x1875495914382976:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612606.440634:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612606.440668:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8a6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2234f expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612606.440787:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788612606.440884:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8a6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2234f expref: 23 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.440899:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:3.0:1788612606.440902:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612606.440908:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8a6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2234f expref: 23 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.440923:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241a00, rc 0) 00000100:00100000:3.0:1788612606.440990:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:12215:x1875495914382976:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 381us (623us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788612606.440997:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:2.0:1788612606.445660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.445767:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914383232 00000100:00100000:1.0:1788612606.445776:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914383232 00000100:00100000:1.0:1788612606.445831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1788612606.445841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:12215:x1875495914383232:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788612606.446047:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:12215:x1875495914383232:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 206us (395us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788612606.446054:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1788612606.529826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612606.530097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914383360 00000100:00100000:2.0:1788612606.530106:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914383360 00000100:00100000:2.0:1788612606.530174:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:2.0:1788612606.530184:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:12221:x1875495914383360:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612606.530206:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612606.530226:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22356 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.530289:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8a7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.530309:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.530321:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612606.530382:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788612606.530387:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612606.530419:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.530445:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22356 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.530463:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22356 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.530472:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:2.0:1788612606.530522:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612606.530526:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37800, rc 0) 00000100:00100000:2.0:1788612606.530587:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:12221:x1875495914383360:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 404us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612606.530594:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1788612606.539422:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612606.539568:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914383616 00000100:00100000:2.0:1788612606.539577:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914383616 00000100:00100000:2.0:1788612606.539635:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:2.0:1788612606.539644:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:12221:x1875495914383616:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612606.539663:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612606.539681:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2235d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.539809:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8a8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.539824:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8a8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.539835:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8a8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612606.539854:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788612606.539960:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bc8a86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2235d expref: 27 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.539979:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8a8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2235d expref: 26 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.539988:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612606.539991:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612606.539995:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37600, rc 0) 00000100:00100000:2.0:1788612606.540052:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12221:x1875495914383616:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 409us (640us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788612606.540059:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:3.0:1788612606.545377:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.545463:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.545615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384000 00000100:00100000:1.0:1788612606.545638:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384000 00000100:00100000:1.0:1788612606.545689:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1788612606.545698:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12221:x1875495914384000:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612606.545720:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612606.545752:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22364 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.545858:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8aa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.545874:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.545885:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612606.545898:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788612606.545989:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8a9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22364 expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.546008:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22364 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.546018:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:1.0:1788612606.546020:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788612606.546024:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799be00, rc 0) 00000100:00100000:1.0:1788612606.546083:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:12221:x1875495914384000:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 386us (619us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788612606.546091:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:2.0:1788612606.548120:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914383744 00000100:00100000:2.0:1788612606.548134:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914383744 00000100:00100000:2.0:1788612606.548204:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788612606.548215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8103480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:2397:x1875495914383744:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612606.548230:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612606.548255:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8a8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2235d expref: 28 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.548273:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612606.548278:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612606.548451:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8103480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:2397:x1875495914383744:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 238us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612606.548459:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1788612606.560363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.560413:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.560454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.560544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.560573:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.560595:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.560622:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384640 00000100:00100000:3.0:1788612606.560630:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384640 00000100:00100000:3.0:1788612606.560679:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384256 00000100:00100000:3.0:1788612606.560689:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384256 00000100:00100000:3.0:1788612606.560712:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384512 00000100:00100000:3.0:1788612606.560715:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384512 00000100:00100000:3.0:1788612606.560732:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 322 00000100:00100000:3.0:1788612606.560740:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914384640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612606.560834:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914384640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612606.560842:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 322 00000100:00100000:3.0:1788612606.560861:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 323 00000100:00100000:3.0:1788612606.560869:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914384256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612606.560895:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914384256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612606.560902:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 323 00000100:00100000:3.0:1788612606.560914:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 324 00000100:00100000:3.0:1788612606.560921:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914384512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612606.560947:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914384512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612606.560954:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 324 00000100:00100000:0.0:1788612606.561142:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384128 00000100:00100000:0.0:1788612606.561147:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384128 00000100:00100000:0.0:1788612606.561180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 388 00000100:00100000:0.0:1788612606.561186:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914384128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612606.561221:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914384128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612606.561228:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 388 00000100:00100000:1.0:1788612606.561361:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384384 00000100:00100000:1.0:1788612606.561366:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384384 00000100:00100000:1.0:1788612606.561401:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384768 00000100:00100000:1.0:1788612606.561404:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384768 00000100:00100000:1.0:1788612606.561429:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:1.0:1788612606.561436:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914384384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612606.561469:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2395:x1875495914384384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.561499:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:1.0:1788612606.561512:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1788612606.561519:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914384768:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:1.0:1788612606.561551:0:8543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.561572:0:8543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.561581:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612606.561585:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612606.561590:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.561622:0:8543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.561635:0:8543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 6 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.561662:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932278144:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612606.561725:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a543c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788612606.561994:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612606.561999:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612606.569550:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932278144:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612606.569581:0:8543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612606.570077:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612606.570170:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384896 00000100:00100000:2.0:1788612606.570177:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384896 00002000:00100000:2.0:1788612606.570235:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9611c81ec700 x1875495914384896/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:252/0 lens 504/0 e 0 to 0 dl 1788612617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612606.570245:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c81ec700 with x1875495914384896 ext(0->12) 00010000:00010000:2.0:1788612606.570252:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 7 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.570267:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 7 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612606.570274:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c81ec700 00000100:00100000:2.0:1788612606.570307:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788612606.570316:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914384896:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:2.0:1788612606.573128:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914384896:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 2803us (3042us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788612606.573143:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00002000:00100000:2.0:1788612606.573167:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9611c81ec700 x1875495914384896/t4294967306(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:252/0 lens 504/448 e 0 to 0 dl 1788612617 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612606.573177:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c81ec700 with x1875495914384896 ext(0->12) 00010000:00010000:2.0:1788612606.573189:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 9 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.573211:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 9 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612606.573931:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c81ec700 00000100:00100000:3.0:1788612606.581381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612606.581533:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385024 00000100:00100000:0.0:1788612606.581542:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385024 00010000:00010000:0.0:1788612606.581578:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 9 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612606.581618:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1788612606.581627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2396:x1875495914385024:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612606.581640:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788612606.581655:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788612606.581658:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788612606 00002000:00010000:0.0:1788612606.581660:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788612606 00002000:00010000:0.0:1788612606.581662:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788612606 00002000:00010000:0.0:1788612606.581664:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788612606.581670:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 9 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.581685:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 9 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.581705:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004afab0fd/0x1f8616bf0bc8a63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22348 expref: 9 pid: 8439 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.581720:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612606.581724:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612606.581730:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.581757:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.581801:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612606.581852:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2396:x1875495914385024:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 225us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612606.581859:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00010000:00010000:1.0:1788612606.581981:0:8543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.581992:0:8543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582010:0:8543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582018:0:8543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582026:0:8543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582032:0:8543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612606.582036:0:8543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582057:0:8543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582068:0:8543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.582076:0:8543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0320a09/0x1f8616bf0bc8ab0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.582119:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914384768:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 20599us (21522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.582126:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1788612606.589584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612606.589752:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385280 00000100:00100000:0.0:1788612606.589762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385280 00000100:00100000:0.0:1788612606.589839:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1788612606.589851:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12221:x1875495914385280:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:0.0:1788612606.589929:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22364 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612606.590138:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788612606.590660:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788612606.591516:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788612606.591557:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.591574:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 31 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.591583:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.591619:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 31 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.591648:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 31 pid: 12327 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612606.591663:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875495932278272:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612606.593381:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612606.597982:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875495932278272:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612606.598015:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.602331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612606.602514:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385408 00000100:00100000:0.0:1788612606.602523:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385408 00010000:00010000:0.0:1788612606.602563:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 32 pid: 12327 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612606.602594:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1788612606.602603:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:2395:x1875495914385408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612606.602615:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612606.602623:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 32 pid: 12327 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.602636:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 32 pid: 12327 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.602657:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8a4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2233a expref: 32 pid: 12327 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.602703:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:0.0:1788612606.602708:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.602718:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.602726:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.602764:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612606.602815:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:2395:x1875495914385408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 213us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612606.602823:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00010000:00010000:2.0:1788612606.603409:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.603419:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612606.603554:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788612606.603655:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788612606.603748:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c810b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932278400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788612606.603802:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612606.603827:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612606.604056:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932278400 00000100:00100000:0.0:1788612606.604063:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932278400 00000100:00100000:0.0:1788612606.604104:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788612606.604113:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875495932278400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788612606.604196:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875495932278400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612606.604204:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1788612606.604313:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612606.605146:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c810b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932278400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788612606.605431:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788612606.605521:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c810b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932278528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788612606.605572:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612606.605600:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612606.605960:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932278528 00000100:00100000:0.0:1788612606.605967:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932278528 00000100:00100000:0.0:1788612606.606013:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788612606.606021:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875495932278528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788612606.606338:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1875495932278528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 317us (764us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788612606.606374:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788612606.607428:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c810b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932278528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788612606.607627:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788612606.607960:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.607971:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.607988:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.607993:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612606.607998:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.608006:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.608022:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:3.0:1788612606.608025:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788612606.608030:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.608036:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8ab7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612606.608138:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788612606.608328:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788612606.608339:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420991862506ns, next at 421991860240ns, rc = 0 00000001:00080000:3.0:1788612606.608357:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788612606.608384:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:3.0:1788612606.608387:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788612606.608393:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8aa2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22364 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612606.609145:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12221:x1875495914385280:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 19294us (19568us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788612606.609176:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000020:00080000:3.0:1788612606.609182:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788612606.613148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.613338:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385536 00000100:00100000:3.0:1788612606.613358:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385536 00000100:00100000:3.0:1788612606.613417:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:3.0:1788612606.613427:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12221:x1875495914385536:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612606.613448:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612606.613469:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8abe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2236b expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.613549:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8abe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2236b expref: 35 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.613564:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8abe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2236b expref: 35 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612606.613583:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612606.613586:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612606.613590:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241a00, rc 0) 00000100:00100000:3.0:1788612606.613653:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12221:x1875495914385536:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 227us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612606.613660:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:2.0:1788612606.617919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.617991:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385792 00000100:00100000:1.0:1788612606.618000:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385792 00000100:00100000:1.0:1788612606.618053:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:1.0:1788612606.618063:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12221:x1875495914385792:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788612606.618404:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+36:12221:x1875495914385792:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 340us (491us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788612606.618412:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1788612606.707550:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612606.707652:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386048 00000100:00100000:2.0:1788612606.707661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386048 00000100:00100000:2.0:1788612606.707726:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:2.0:1788612606.707750:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+36:12231:x1875495914386048:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612606.707773:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612606.707794:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22372 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612606.707910:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788612606.708007:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8ac5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22372 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.708020:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:2.0:1788612606.708023:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612606.708029:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22372 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612606.708043:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36e00, rc 0) 00000100:00100000:2.0:1788612606.708106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12231:x1875495914386048:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 372us (565us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788612606.708113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:2.0:1788612606.713076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.713161:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386176 00000100:00100000:1.0:1788612606.713188:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386176 00000100:00100000:1.0:1788612606.713245:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:1.0:1788612606.713270:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12231:x1875495914386176:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1788612606.713336:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713362:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713376:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713385:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713392:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713398:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713462:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713469:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713506:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612606.713566:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713578:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713590:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713597:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713603:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.713607:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713614:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713626:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612606.713629:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612606.713634:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713639:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ad3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713652:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713657:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713663:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713678:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.713686:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713692:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713701:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c93f7000) 00010000:00010000:1.0:1788612606.713704:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612606.713706:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713712:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8ada lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713721:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713726:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713732:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713753:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.713756:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713761:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713769:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612606.713771:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612606.713780:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.713787:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8ae1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.713865:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12231:x1875495914386176:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 595us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.713873:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1788612606.717958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.718073:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386432 00000100:00100000:1.0:1788612606.718083:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386432 00000100:00100000:1.0:1788612606.718134:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1788612606.718143:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12231:x1875495914386432:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788612606.718502:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:12231:x1875495914386432:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 358us (551us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788612606.718511:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1788612606.767471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612606.767813:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386688 00000100:00100000:0.0:1788612606.767823:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386688 00000100:00100000:0.0:1788612606.767883:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1788612606.767893:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:12234:x1875495914386688:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612606.767916:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612606.767936:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8ae8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22379 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768012:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768026:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768036:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768047:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768054:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768060:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768422:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768444:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768452:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612606.768463:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788612606.768565:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768573:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768579:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768585:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612606.768589:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768597:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768609:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:0.0:1788612606.768612:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612606.768617:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768623:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8aef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768635:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768647:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768652:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768657:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612606.768660:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768878:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768887:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c93f7000) 00010000:00010000:0.0:1788612606.768890:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612606.768893:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768899:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8af6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768938:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8ae8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 41 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768953:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 40 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612606.768961:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612606.768964:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612606.768972:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612606.769094:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12234:x1875495914386688:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1201us (1633us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788612606.769102:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:2.0:1788612606.774608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612606.774802:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386816 00000100:00100000:1.0:1788612606.774811:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386816 00000100:00100000:1.0:1788612606.774889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:1.0:1788612606.774900:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12234:x1875495914386816:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1788612606.774966:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.774993:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775006:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775039:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775059:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775066:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775072:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612606.775076:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775084:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775095:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612606.775098:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612606.775103:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612606.775109:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612606.775190:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12234:x1875495914386816:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 290us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612606.775198:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:0.0:1788612606.778257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612606.778433:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387072 00000100:00100000:3.0:1788612606.778442:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387072 00000100:00100000:3.0:1788612606.778515:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612606.778525:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12234:x1875495914387072:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612606.778892:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+41:12234:x1875495914387072:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 366us (641us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788612606.778900:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612607.034571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612607.034681:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387328 00000100:00100000:2.0:1788612607.034691:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387328 00000100:00100000:2.0:1788612607.034757:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:2.0:1788612607.034768:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+41:12265:x1875495914387328:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1788612607.034792:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612607.034812:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8b12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22380 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.034912:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8b19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.034943:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.034954:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612607.034966:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788612607.035224:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8b12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22380 expref: 44 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.035255:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22380 expref: 43 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.035263:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612607.035267:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612607.035270:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36a00, rc 0) 00000100:00100000:2.0:1788612607.035332:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12265:x1875495914387328:12345-192.168.203.30@tcp:101:cat.0 Request processed in 566us (768us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788612607.035350:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:3.0:1788612607.039851:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.039900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612607.039943:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387712 00000100:00100000:2.0:1788612607.039953:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387712 00000100:00100000:2.0:1788612607.040032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1788612607.040043:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9283450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:2397:x1875495914387712:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612607.040058:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612607.040082:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8b19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22380 expref: 43 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.040130:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612607.040135:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612607.040193:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9283450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:2397:x1875495914387712:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 151us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612607.040200:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788612607.040579:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387584 00000100:00100000:1.0:1788612607.040584:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387584 00000100:00100000:1.0:1788612607.040623:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1788612607.040631:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:12265:x1875495914387584:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:1.0:1788612607.040828:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12265:x1875495914387584:12345-192.168.203.30@tcp:35:cat.0 Request processed in 196us (984us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788612607.040842:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1788612607.115085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612607.115134:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387968 00000100:00100000:0.0:1788612607.115154:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387968 00000100:00100000:0.0:1788612607.115220:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:0.0:1788612607.115231:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12271:x1875495914387968:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788612607.115265:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612607.115269:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788612607.115295:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc8a7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22356 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.115315:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:0.0:1788612607.115320:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612607.115333:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8b27 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22387 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.115449:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.115464:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 43 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.115472:0:8253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.115564:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 43 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.115590:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 43 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612607.115603:0:8253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8253:1875495932278656:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612607.115703:0:8253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612607.120605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.120810:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388096 00000100:00100000:1.0:1788612607.120820:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388096 00010000:00010000:1.0:1788612607.120861:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 44 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612607.121034:0:8253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8253:1875495932278656:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612607.121060:0:8253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612607.121608:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:1.0:1788612607.121621:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:2395:x1875495914388096:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612607.121635:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612607.121642:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 44 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.121656:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 44 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.121679:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8afd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22379 expref: 44 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.121694:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.121698:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.121707:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.121714:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.121759:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612607.121813:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:2395:x1875495914388096:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 195us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.121821:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00010000:00010000:0.0:1788612607.124053:0:8253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.124070:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612607.124095:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788612607.124263:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8b27 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 44 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.124285:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 43 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.124294:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612607.124298:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612607.124302:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897600, rc 0) 00000100:00100000:0.0:1788612607.124379:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12271:x1875495914387968:12345-192.168.203.30@tcp:101:dd.0 Request processed in 9149us (9303us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788612607.124403:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:3.0:1788612607.133188:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.133297:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388224 00000100:00100000:1.0:1788612607.133306:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388224 00000100:00100000:1.0:1788612607.133376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1788612607.133386:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12271:x1875495914388224:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788612607.133409:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612607.133428:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2238e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.133459:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.133496:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.133507:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.133614:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8b3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.133632:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.133641:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.133651:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612607.133655:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b000, rc 0) 00000100:00100000:1.0:1788612607.133714:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:12271:x1875495914388224:12345-192.168.203.30@tcp:101:dd.0 Request processed in 328us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.133721:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:3.0:1788612607.135947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612607.136047:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388480 00000100:00100000:0.0:1788612607.136056:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388480 00000100:00100000:0.0:1788612607.136119:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:0.0:1788612607.136131:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:12271:x1875495914388480:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788612607.136523:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.136540:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.136550:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612607.136590:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788612607.136612:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034803935 reply state 00000000b38ea995 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.136624:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.136631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.136634:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612607.136638:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612607.136718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:12271:x1875495914388480:12345-192.168.203.30@tcp:36:dd.0 Request processed in 588us (776us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788612607.136725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 170 00000020:00080000:1.0:1788612607.136730:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612607.346938:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612607.421856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612607.422196:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388608 00000100:00100000:0.0:1788612607.422207:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388608 00000100:00100000:0.0:1788612607.422285:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:0.0:1788612607.422295:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:12285:x1875495914388608:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:0.0:1788612607.422318:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612607.422351:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8b51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22395 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422417:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422432:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422445:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422456:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422465:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422524:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422594:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422605:0:8253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 48 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422612:0:8253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422643:0:8253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 48 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.422655:0:8253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 48 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612607.422667:0:8253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8253:1875495932278784:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612607.422768:0:8253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612607.431248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.431320:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388864 00000100:00100000:1.0:1788612607.431345:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388864 00000100:00100000:0.0:1788612607.431364:0:8253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8253:1875495932278784:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612607.431391:0:8253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612607.431402:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1788612607.431411:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+49:6164:x1875495914388864:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788612607.431736:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+50:6164:x1875495914388864:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 326us (495us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788612607.431744:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000001:00080000:3.0:1788612607.435576:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:3.0:1788612607.435611:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788612607.435639:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9611c696a000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788612607.435645:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9613006fae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9611c696af00 00000020:00080000:3.0:1788612607.435649:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612ec046a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9611c8134800 00000020:00080000:0.0:1788612607.435730:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788612607.435794:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788612607.435962:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932278912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788612607.436041:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612607.436173:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932278912 00000100:00100000:3.0:1788612607.436181:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932278912 00000100:00100000:3.0:1788612607.436362:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788612607.436373:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932278912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788612607.436399:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1788612607.436432:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c0ffe, atime: 0x6a9c0ffe, ctime: 0x6a9c0ffe, blocks: 0x8 00010000:00010000:3.0:1788612607.436439:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.436465:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788612607.436469:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612607.436493:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.436511:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.436520:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.436528:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.436545:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612607.436697:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612607.436705:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436712:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612607.436717:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436726:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436742:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436749:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc8b6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436768:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612607.436770:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612607.436771:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612607.436817:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.436841:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388992 00000100:00100000:1.0:1788612607.436845:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388992 00010000:00010000:1.0:1788612607.436865:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 22 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612607.436898:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1788612607.436906:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:2394:x1875495914388992:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612607.436916:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612607.436923:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 22 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436934:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 22 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436952:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8b2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22387 expref: 22 pid: 8253 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436965:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.436970:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436979:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.436987:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437009:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612607.437047:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:2394:x1875495914388992:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 142us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.437054:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00010000:00010000:1.0:1788612607.437077:0:8253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437091:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612607.437138:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788612607.437142:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612607.437164:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437177:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437185:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437191:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437197:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437202:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612607.437205:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437211:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437219:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612607.437222:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612607.437225:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437240:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8b58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437252:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437258:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437263:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437267:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612607.437270:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437275:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437283:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c93f7000) 00010000:00010000:1.0:1788612607.437285:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612607.437288:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437293:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8b5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437321:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8b51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22395 expref: 21 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437334:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22395 expref: 20 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.437358:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.437360:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612607.437363:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897200, rc 0) 00000100:00100000:1.0:1788612607.437386:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12285:x1875495914388608:12345-192.168.203.30@tcp:101:stat.0 Request processed in 15093us (15540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.437393:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 171 00010000:00010000:2.0:1788612607.442360:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442378:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442385:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442391:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612607.442396:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442404:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442420:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9612c4d8be00) 00010000:00010000:2.0:1788612607.442424:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612607.442429:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442435:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8a01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442499:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442506:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442510:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442515:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612607.442518:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442548:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442556:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00000100:00100000:3.0:1788612607.442681:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932278912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6306us (6635us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788612607.442691:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1788612607.442804:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c7b4df80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788612607.442812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932278912:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788612607.442813:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612607.442818:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442824:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8a08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442838:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442844:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442850:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442862:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612607.442865:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442871:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442888:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c93f7000) 00010000:00010000:2.0:1788612607.442891:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612607.442894:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442899:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8a47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442917:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442922:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442927:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442932:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612607.442935:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442941:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442959:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612607.442962:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612607.442965:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612607.442971:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8b4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612607.471708:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612607.471731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932279040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612607.471797:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612607.471870:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279040 00000100:00100000:0.0:1788612607.472044:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932279296:0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.472086:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612607.472113:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932279808:0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.472145:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932279168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612607.472171:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932280320:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472178:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472198:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932279680:0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.472200:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612607.472228:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932280320 00000100:00100000:2.0:1788612607.472233:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612607.472235:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932280320 00000100:00100000:2.0:1788612607.472249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932280192:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472282:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932280704:0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.472284:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932280192 00000100:00100000:0.0:1788612607.472287:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932280192 00000100:00100000:2.0:1788612607.472299:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612607.472305:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932280704 00000100:00100000:0.0:1788612607.472307:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932280704 00000100:00100000:2.0:1788612607.472327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279296 00000100:00100000:0.0:1788612607.472343:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788612607.472344:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279296 00000100:00100000:0.0:1788612607.472351:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932280320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788612607.472378:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932279296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472419:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932279296:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612607.472432:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788612607.472462:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279168 00000100:00100000:2.0:1788612607.472466:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279168 00000100:00100000:2.0:1788612607.472514:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788612607.472534:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fefbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875495932279168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612607.472549:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612607.472585:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fefbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875495932279168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612607.472591:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788612607.472610:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932279552:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472633:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472651:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932280064:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472670:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472684:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932280576:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472704:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472721:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788612607.472727:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932279424:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472747:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472763:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932279936:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472796:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.472815:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932280448:0@lo:400:kworker.0 00000100:00100000:2.0:1788612607.472836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612607.473196:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932280320:12345-0@lo:400:kworker.0 Request processed in 845us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612607.473203:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788612607.473220:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788612607.473227:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932280192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.473255:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932280192:12345-0@lo:400:kworker.0 Request processed in 30us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612607.473261:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788612607.473271:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788612607.473285:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932280704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.473314:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932280704:12345-0@lo:400:kworker.0 Request processed in 30us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612607.473319:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788612607.473376:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279808 00000100:00100000:1.0:1788612607.473381:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279808 00000100:00100000:0.0:1788612607.473382:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279552 00000100:00100000:0.0:1788612607.473384:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279552 00000100:00100000:0.0:1788612607.473404:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788612607.473410:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932279552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612607.473446:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932279552:12345-0@lo:400:kworker.0 Request processed in 36us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612607.473451:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788612607.473504:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279040 00000100:00100000:3.0:1788612607.473536:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788612607.473542:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932279040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612607.473554:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612607.473595:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932279040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.473601:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788612607.473826:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612607.473830:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612607.473869:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932279040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612607.473925:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279680 00000100:00100000:3.0:1788612607.473929:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279680 00000100:00100000:3.0:1788612607.473948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932280064 00000100:00100000:3.0:1788612607.473951:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932280064 00000100:00100000:3.0:1788612607.473970:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932280576 00000100:00100000:3.0:1788612607.473973:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932280576 00000100:00100000:3.0:1788612607.473985:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279424 00000100:00100000:3.0:1788612607.473987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279424 00000100:00100000:3.0:1788612607.473997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932279936 00000100:00100000:3.0:1788612607.473999:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932279936 00000100:00100000:3.0:1788612607.474010:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932280448 00000100:00100000:3.0:1788612607.474012:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932280448 00000100:00100000:3.0:1788612607.474026:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788612607.474032:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932279680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474067:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932279680:12345-0@lo:400:kworker.0 Request processed in 35us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.474073:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788612607.474085:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788612607.474091:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932280064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474118:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c810ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932280064:12345-0@lo:400:kworker.0 Request processed in 27us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.474124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788612607.474135:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788612607.474148:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932280576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474175:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932280576:12345-0@lo:400:kworker.0 Request processed in 28us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.474181:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788612607.474192:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788612607.474197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932279424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474229:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932279424:12345-0@lo:400:kworker.0 Request processed in 33us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.474234:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788612607.474244:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788612607.474250:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932279936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474275:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932279936:12345-0@lo:400:kworker.0 Request processed in 26us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.474280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788612607.474290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788612607.474295:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932280448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474320:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932280448:12345-0@lo:400:kworker.0 Request processed in 24us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.474325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:3.0:1788612607.474349:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612607.474352:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612607.474384:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932279424:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474395:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932279936:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474405:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932280448:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474426:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932279552:0@lo:400:kworker.0 00010000:00080000:3.0:1788612607.474438:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7b4ea00 x1875495932280064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612607.474447:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932280064:0@lo:400:kworker.0 00010000:00080000:3.0:1788612607.474457:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79f6680 x1875495932280576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612607.474465:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932280576:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474551:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932279168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612607.474561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932279680:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474570:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932280192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474579:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932280704:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474605:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.474614:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932279296:0@lo:400:kworker.0 00000100:00100000:1.0:1788612607.480368:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788612607.480393:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932279808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612607.480510:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932279808:12345-0@lo:400:kworker.0 Request processed in 129us (8364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.480518:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788612607.481037:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932279808:0@lo:400:kworker.0 00000100:00100000:3.0:1788612607.518252:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.518395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389248 00000100:00100000:1.0:1788612607.518405:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389248 00000100:00100000:1.0:1788612607.518459:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 172 00000100:00100000:1.0:1788612607.518467:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+17:12291:x1875495914389248:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:1.0:1788612607.518561:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612607.518588:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc8b66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22395 expref: 17 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.518608:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.518613:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612607.519048:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.519076:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.519086:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612607.519122:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788612607.519527:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b3a9730 reply state 000000008f2a9e34 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.519542:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.519550:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.519553:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612607.519555:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612607.519654:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12291:x1875495914389248:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 1185us (1409us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788612607.519662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 172 00000020:00080000:1.0:1788612607.519667:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788612607.665084:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.665227:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389376 00000100:00100000:3.0:1788612607.665237:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389376 00000100:00100000:3.0:1788612607.665302:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:3.0:1788612607.665311:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12306:x1875495914389376:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1788612607.665344:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612607.665379:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8b7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2239c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665442:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665455:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665468:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665508:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665516:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665523:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665593:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665603:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665610:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612607.665649:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788612607.665653:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612607.665674:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665693:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665702:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665709:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665716:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665723:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612607.665727:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665735:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665748:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612607.665751:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612607.665756:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665762:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8b82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665776:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665782:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665798:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665804:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612607.665807:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665814:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665822:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6800) 00010000:00010000:3.0:1788612607.665824:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612607.665827:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665832:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8b89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665865:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8b7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665879:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.665886:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612607.665888:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612607.665890:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:3.0:1788612607.666117:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12306:x1875495914389376:12345-192.168.203.30@tcp:101:stat.0 Request processed in 806us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.666135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:3.0:1788612607.730744:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.730837:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389632 00000100:00100000:1.0:1788612607.730845:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389632 00000100:00100000:1.0:1788612607.730907:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:1.0:1788612607.730917:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12316:x1875495914389632:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612607.730935:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612607.730954:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223a3 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612607.731063:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788612607.731163:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8b97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223a3 expref: 22 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.731177:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:1.0:1788612607.731180:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612607.731186:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223a3 expref: 22 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.731199:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b600, rc 0) 00000100:00100000:1.0:1788612607.731259:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12316:x1875495914389632:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 343us (525us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788612607.731265:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:2.0:1788612607.737565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.737645:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389888 00000100:00100000:3.0:1788612607.737653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389888 00000100:00100000:3.0:1788612607.737702:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1788612607.737715:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12316:x1875495914389888:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612607.737905:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:12316:x1875495914389888:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 196us (350us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788612607.737911:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1788612607.794255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.794352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390144 00000100:00100000:1.0:1788612607.794360:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390144 00000100:00100000:1.0:1788612607.794428:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:1.0:1788612607.794438:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:12322:x1875495914390144:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612607.794461:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612607.794506:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8ba5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223aa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.794623:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.794639:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.794667:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.794702:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.794717:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 23 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612607.794730:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612d8193100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932280832:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612607.794841:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612607.797151:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612d8193100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932280832:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612607.797181:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612607.803009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612607.803375:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390272 00000100:00100000:0.0:1788612607.803386:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390272 00010000:00010000:0.0:1788612607.803431:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 24 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612607.803505:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:0.0:1788612607.803516:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:2395:x1875495914390272:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612607.803530:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612607.803537:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 24 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.803549:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 24 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.803702:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8b90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2239c expref: 24 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.803743:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612607.803749:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.803758:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.803766:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612607.803797:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612607.803849:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:2395:x1875495914390272:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 335us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612607.803856:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00010000:00010000:1.0:1788612607.804944:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.804957:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612607.804976:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788612607.805102:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8ba5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.805121:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.805166:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.805169:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612607.805172:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a400, rc 0) 00000100:00100000:1.0:1788612607.805230:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:12322:x1875495914390144:12345-192.168.203.30@tcp:101:bash.0 Request processed in 10793us (10983us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788612607.805237:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:2.0:1788612607.809069:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.809221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390528 00000100:00100000:3.0:1788612607.809230:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390528 00000100:00100000:3.0:1788612607.809274:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:3.0:1788612607.809283:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:12322:x1875495914390528:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1788612607.809535:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.809554:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.809566:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612607.809608:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788612607.809629:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d329fe7 reply state 00000000cd48131c transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.809642:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.809667:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612607.809669:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612607.809673:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612607.809889:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12322:x1875495914390528:12345-192.168.203.30@tcp:36:bash.0 Request processed in 606us (827us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788612607.809907:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 176 00000020:00080000:3.0:1788612607.809916:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788612607.814561:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.814622:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390656 00000100:00100000:3.0:1788612607.814632:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390656 00000100:00100000:3.0:1788612607.814685:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:3.0:1788612607.814697:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12322:x1875495914390656:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612607.814723:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612607.814744:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8bc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.814866:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.814881:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.814890:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.814922:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.815002:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 27 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612607.815020:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932280960:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612607.815094:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612607.819026:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.819105:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390784 00000100:00100000:1.0:1788612607.819113:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390784 00010000:00010000:1.0:1788612607.819152:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 28 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612607.819198:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1788612607.819209:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:2395:x1875495914390784:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612607.819223:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612607.819230:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 28 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.819244:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 28 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.819267:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.819273:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.819282:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.819309:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.819328:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612607.819667:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:2395:x1875495914390784:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 458us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.819674:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00010000:00010000:3.0:1788612607.819728:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8bac lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223aa expref: 27 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612607.819744:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932280960:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612607.819764:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.819772:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.819778:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612607.819828:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788612607.819832:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612607.819852:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.819882:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8bc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223b1 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.819897:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223b1 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.819904:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612607.819916:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612607.819919:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240400, rc 0) 00000100:00100000:3.0:1788612607.819945:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12322:x1875495914390656:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5251us (5395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.819953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:2.0:1788612607.827576:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.827698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391040 00000100:00100000:3.0:1788612607.827708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391040 00000100:00100000:3.0:1788612607.827762:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1788612607.827772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12322:x1875495914391040:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1788612607.827975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12322:x1875495914391040:12345-192.168.203.30@tcp:35:bash.0 Request processed in 204us (417us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788612607.827983:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1788612607.931779:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.932027:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391296 00000100:00100000:1.0:1788612607.932037:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391296 00000100:00100000:1.0:1788612607.932101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:1.0:1788612607.932112:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12332:x1875495914391296:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612607.932135:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612607.932167:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612607.932265:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788612607.932379:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8bcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223b8 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.932393:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:1.0:1788612607.932397:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612607.932402:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223b8 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.932417:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b600, rc 0) 00000100:00100000:1.0:1788612607.932520:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:12332:x1875495914391296:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 410us (750us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788612607.932544:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:2.0:1788612607.935877:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.935977:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391424 00000100:00100000:1.0:1788612607.935986:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391424 00000100:00100000:1.0:1788612607.936043:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:1.0:1788612607.936053:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:12332:x1875495914391424:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1788612607.936122:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936138:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936159:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936175:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936182:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936188:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936256:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936266:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936273:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612607.936331:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936359:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936365:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936372:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936378:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ae00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612607.936382:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936389:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936400:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612607.936403:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612607.936408:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936415:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8bdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936426:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936432:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936445:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936450:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612607.936453:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936459:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936466:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612607.936469:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612607.936472:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936510:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8be4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936526:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936532:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936538:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936543:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612607.936546:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936573:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936582:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.936585:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612607.936588:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.936594:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8beb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612607.936663:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:12332:x1875495914391424:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 610us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.936671:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:2.0:1788612607.939262:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.939352:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391680 00000100:00100000:3.0:1788612607.939361:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391680 00000100:00100000:3.0:1788612607.939421:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1788612607.939432:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:12332:x1875495914391680:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612607.939671:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:12332:x1875495914391680:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 240us (417us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788612607.939678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1788612607.983944:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932281088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612607.984019:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612607.984401:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932281088 00000100:00100000:3.0:1788612607.984410:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932281088 00000100:00100000:3.0:1788612607.984467:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788612607.984496:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932281088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612607.984525:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788612607.984575:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932281088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.984599:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788612607.984620:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612607.984630:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932281216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612607.984658:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612607.984690:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932281216 00000100:00100000:3.0:1788612607.984694:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932281216 00000100:00100000:3.0:1788612607.984717:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788612607.984723:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932281216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612607.984734:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788612607.984763:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932281216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.984769:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788612607.984809:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932281216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612607.984970:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932281088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612607.985157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612607.985300:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932281344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612607.985343:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612607.985531:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932281344 00000100:00100000:2.0:1788612607.985536:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932281344 00000100:00100000:2.0:1788612607.985576:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788612607.985584:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932281344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612607.985607:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612607.985644:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932281344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612607.985651:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788612607.985723:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932281344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612607.985830:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391936 00000100:00100000:3.0:1788612607.985835:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391936 00000100:00100000:3.0:1788612607.985875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:3.0:1788612607.985882:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:12335:x1875495914391936:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612607.985896:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612607.985917:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8bf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.985986:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986001:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986029:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986045:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986052:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986059:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986177:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986188:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986196:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612607.986206:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788612607.986279:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986286:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986292:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986298:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612607.986308:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986318:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986331:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612607.986344:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612607.986349:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986356:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8bf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986578:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986587:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986593:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986599:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612607.986603:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986610:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986619:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6800) 00010000:00010000:3.0:1788612607.986622:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612607.986631:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986638:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986684:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8bf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223bf expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986699:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8c07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223bf expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.986706:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612607.986709:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612607.986711:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240c00, rc 0) 00000100:00100000:3.0:1788612607.987254:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:12335:x1875495914391936:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1368us (2095us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788612607.987263:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:2.0:1788612607.991195:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612607.991276:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392064 00000100:00100000:3.0:1788612607.991286:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392064 00000100:00100000:3.0:1788612607.991357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:3.0:1788612607.991379:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:12335:x1875495914392064:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1788612607.991448:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991467:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991514:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991567:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991575:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991582:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991588:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612607.991593:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991601:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991612:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612607.991615:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612607.991619:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612607.991626:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612607.991700:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:12335:x1875495914392064:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 322us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612607.991709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:2.0:1788612607.995603:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612607.995734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612607.996269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392448 00000100:00100000:1.0:1788612607.996279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392448 00000100:00100000:1.0:1788612607.996353:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1788612607.996371:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:2395:x1875495914392448:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612607.996387:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612607.996413:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8c07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223bf expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612607.996432:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612607.996436:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612607.996523:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:2395:x1875495914392448:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 161us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612607.996548:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1788612607.997880:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392320 00000100:00100000:3.0:1788612607.997891:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392320 00000100:00100000:3.0:1788612607.997973:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1788612607.997996:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:12335:x1875495914392320:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612607.998230:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:12335:x1875495914392320:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 235us (2636us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788612607.998237:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1788612608.166792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.166890:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392704 00000100:00100000:3.0:1788612608.166902:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392704 00000100:00100000:3.0:1788612608.166983:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:3.0:1788612608.166993:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+31:12353:x1875495914392704:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1788612608.167020:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.167041:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223c6 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.167154:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8c23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.167169:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8c23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.167180:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8c23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612608.167191:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788612608.167306:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223c6 expref: 34 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.167327:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8c23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223c6 expref: 33 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.167867:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.167871:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788612608.167876:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241200, rc 0) 00000100:00100000:3.0:1788612608.167963:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12353:x1875495914392704:12345-192.168.203.30@tcp:101:cat.0 Request processed in 970us (1180us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788612608.167971:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00080000:0.0:1788612608.171045:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612608.213101:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.213202:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392832 00000100:00100000:3.0:1788612608.213211:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392832 00000100:00100000:3.0:1788612608.213269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:3.0:1788612608.213279:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12354:x1875495914392832:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612608.213302:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.213324:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.213410:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.213425:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.213437:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612608.213513:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788612608.213517:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612608.213536:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.213940:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223cd expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.213961:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223cd expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.213970:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612608.213973:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612608.213977:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:3.0:1788612608.214098:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12354:x1875495914392832:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 819us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.214105:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:1.0:1788612608.219674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.219891:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393216 00000100:00100000:3.0:1788612608.219900:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393216 00000100:00100000:3.0:1788612608.219961:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1788612608.219971:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12354:x1875495914393216:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612608.220258:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12354:x1875495914393216:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 287us (593us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788612608.220266:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:2.0:1788612608.223211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612608.223304:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393344 00000100:00100000:0.0:1788612608.223315:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393344 00000100:00100000:0.0:1788612608.223418:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1788612608.223429:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12354:x1875495914393344:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:0.0:1788612608.223444:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788612608.223469:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8bc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223b1 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.223524:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8c23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223c6 expref: 34 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.223537:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8abe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2236b expref: 33 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.223547:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612608.223551:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612608.223618:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12354:x1875495914393344:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 190us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612608.223626:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1788612608.226889:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.227012:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393472 00000100:00100000:3.0:1788612608.227022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393472 00000100:00100000:3.0:1788612608.227078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:3.0:1788612608.227087:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12354:x1875495914393472:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:3.0:1788612608.227237:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.227264:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.227277:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612608.227392:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788612608.227725:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12354:x1875495914393472:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 636us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.227810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1788612608.253221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.253321:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393600 00000100:00100000:3.0:1788612608.253340:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393600 00000100:00100000:3.0:1788612608.253411:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:3.0:1788612608.253422:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12356:x1875495914393600:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612608.253443:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.253467:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223d4 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253586:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253601:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253612:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253629:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253655:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253662:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253731:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253741:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253748:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612608.253790:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788612608.253794:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612608.253813:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253825:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253832:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253838:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253844:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253858:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.253862:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253869:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253881:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612608.253883:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612608.253888:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253894:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8c4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253907:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253913:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253919:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253923:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.253926:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253931:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253947:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6800) 00010000:00010000:3.0:1788612608.253949:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612608.253952:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253957:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.253989:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 34 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.254001:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 33 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.254008:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.254010:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612608.254013:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:3.0:1788612608.254068:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12356:x1875495914393600:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 648us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.254075:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000040:00080000:1.0:1788612608.305461:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612608.305472:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612608.305530:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788612608.305539:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612608.305678:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301804e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932281472:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612608.305795:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612608.310117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.310238:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301804e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932281472:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788612608.310408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393728 00000100:00100000:0.0:1788612608.310415:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393728 00000100:00100000:0.0:1788612608.310468:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:0.0:1788612608.310515:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12363:x1875495914393728:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612608.310546:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612608.310656:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12363:x1875495914393728:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 178us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612608.310664:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:2.0:1788612608.329832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.329929:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393856 00000100:00100000:1.0:1788612608.329938:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393856 00000100:00100000:1.0:1788612608.329996:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1788612608.330007:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12363:x1875495914393856:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788612608.330084:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330101:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330112:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330151:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330160:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330180:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330210:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330220:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330226:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612608.330270:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788612608.330274:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612608.330287:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330423:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330432:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330439:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330445:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612608.330449:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330458:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330500:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:1.0:1788612608.330503:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612608.330508:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330515:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8c62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330527:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330534:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330539:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330545:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612608.330548:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330554:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330925:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.330928:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612608.330933:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330939:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8c69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330965:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330971:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330977:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330981:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799be00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612608.330984:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330990:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.330997:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612608.330999:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612608.331002:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.331008:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8c70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.331123:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12363:x1875495914393856:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1116us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612608.331131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1788612608.342051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.342168:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394112 00000100:00100000:3.0:1788612608.342177:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394112 00000100:00100000:3.0:1788612608.342239:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:3.0:1788612608.342249:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+33:12363:x1875495914394112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.342270:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.342800:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223db expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.342910:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.342926:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.342939:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612608.342950:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788612608.343033:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343040:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343048:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343054:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.343058:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343065:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343078:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.343081:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612608.343085:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343104:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343144:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c77 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223db expref: 35 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343154:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:3.0:1788612608.343157:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612608.343161:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223db expref: 35 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.343170:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240800, rc 0) 00000100:00100000:3.0:1788612608.343283:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12363:x1875495914394112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1035us (1241us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788612608.343451:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:0.0:1788612608.356354:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.357078:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394240 00000100:00100000:3.0:1788612608.357089:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394240 00000100:00100000:3.0:1788612608.357157:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:3.0:1788612608.357167:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12363:x1875495914394240:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612608.357200:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612608.357314:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12363:x1875495914394240:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 148us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.357321:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:2.0:1788612608.362698:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.362832:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394496 00000100:00100000:3.0:1788612608.362843:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394496 00000100:00100000:3.0:1788612608.362946:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:3.0:1788612608.362971:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12363:x1875495914394496:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.362993:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.362996:0:12327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788612608.363023:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8c38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223cd expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.363043:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612608.363047:0:12327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612608.363060:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223e2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612608.363457:0:12327:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788612608.363960:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.363975:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.363985:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.364038:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8c8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e2 expref: 36 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.364054:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e2 expref: 35 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.364063:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9611c76e6800) 00010000:00010000:3.0:1788612608.364066:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612608.364076:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241c00, rc 0) 00000100:00100000:3.0:1788612608.364140:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12363:x1875495914394496:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1171us (1450us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788612608.364147:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00010000:00010000:0.0:1788612608.367784:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612608.368950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.369020:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394752 00000100:00100000:3.0:1788612608.369030:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394752 00000100:00100000:3.0:1788612608.369091:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:3.0:1788612608.369102:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12363:x1875495914394752:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.369175:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612608.369201:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8c93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e2 expref: 35 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369221:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9611c76e6800) 00010000:00010000:3.0:1788612608.369233:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612608.369254:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369267:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369275:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369351:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369368:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369375:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369431:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369439:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369445:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369451:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.369455:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369462:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369471:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612608.369513:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612608.369518:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369525:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8ca1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369535:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369541:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369546:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369558:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.369798:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369807:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369815:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xddfe650d (ffff9611c76e6000) 00010000:00010000:3.0:1788612608.369818:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612608.369821:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.369827:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8ca8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xddfe650d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.369905:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12363:x1875495914394752:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 803us (962us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612608.369912:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:0.0:1788612608.375132:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.375303:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394880 00000100:00100000:1.0:1788612608.375313:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394880 00000100:00100000:1.0:1788612608.375404:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:1.0:1788612608.375414:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:12363:x1875495914394880:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612608.375434:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612608.375457:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8caf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223e9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.375534:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.375549:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.375861:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.375972:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8caf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.375989:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.375997:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.375999:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612608.376003:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:1.0:1788612608.376068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12363:x1875495914394880:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 655us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612608.376077:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:1.0:1788612608.379198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.379284:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395136 00000100:00100000:3.0:1788612608.379304:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395136 00000100:00100000:3.0:1788612608.379380:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:3.0:1788612608.379391:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12363:x1875495914395136:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.379531:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.379548:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.379569:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612608.379747:0:12327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788612608.379757:0:12327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422763280813ns, next at 423763277783ns, rc = 0 00000004:00010000:3.0:1788612608.379802:0:12327:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061d2584f reply state 000000001f8d4707 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.379815:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.379822:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:3.0:1788612608.379825:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788612608.379829:0:12327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612608.379914:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12363:x1875495914395136:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 525us (725us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788612608.379922:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:0.0:1788612608.382047:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.382150:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395264 00000100:00100000:3.0:1788612608.382160:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395264 00000100:00100000:3.0:1788612608.382208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:3.0:1788612608.382220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12363:x1875495914395264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.382243:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.382262:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223f0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.382721:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.382846:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.382886:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:3.0:1788612608.382890:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612608.382894:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241800, rc 0) 00000100:00100000:3.0:1788612608.382957:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:12363:x1875495914395264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 739us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.382964:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:0.0:1788612608.389001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612608.389104:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395392 00000100:00100000:2.0:1788612608.389114:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395392 00000100:00100000:2.0:1788612608.389190:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1788612608.389201:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+6:2394:x1875495914395392:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788612608.389453:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914395392:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 254us (461us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788612608.389462:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00080000:0.0:1788612608.390208:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612608.393649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612608.393747:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395648 00000100:00100000:0.0:1788612608.393756:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395648 00000100:00100000:0.0:1788612608.393812:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1788612608.393822:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:12363:x1875495914395648:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788612608.394859:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:12363:x1875495914395648:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 1031us (1560us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788612608.394871:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:2.0:1788612608.411732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.411889:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395904 00000100:00100000:3.0:1788612608.411898:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395904 00000100:00100000:3.0:1788612608.411957:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:3.0:1788612608.411967:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:12363:x1875495914395904:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788612608.412777:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:12363:x1875495914395904:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 807us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.412787:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:2.0:1788612608.421599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.421819:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396032 00000100:00100000:3.0:1788612608.421828:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396032 00000100:00100000:3.0:1788612608.421884:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:3.0:1788612608.421894:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:12363:x1875495914396032:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.421913:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.421933:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8ccb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223f7 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.422003:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8cd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.422029:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.422041:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612608.422083:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612608.422101:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.422128:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8ccb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f7 expref: 41 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.422253:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f7 expref: 40 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.422264:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:3.0:1788612608.422267:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788612608.422270:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240800, rc 0) 00000100:00100000:3.0:1788612608.422344:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12363:x1875495914396032:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 451us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.422351:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:0.0:1788612608.426815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.426881:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396160 00000100:00100000:3.0:1788612608.426891:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396160 00000100:00100000:3.0:1788612608.426950:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612608.426961:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914396160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.426978:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612608.426997:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d223fe expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612608.427027:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c1000, blocks: 0x0 00010000:00010000:3.0:1788612608.427046:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788612608.427050:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612608.427060:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.427078:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.427091:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:3.0:1788612608.427148:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914396160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 188us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.427154:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1788612608.431165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.431234:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396416 00000100:00100000:3.0:1788612608.431243:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396416 00000100:00100000:3.0:1788612608.431310:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:3.0:1788612608.431321:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fedbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12363:x1875495914396416:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788612608.431436:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fedbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12363:x1875495914396416:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.431443:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:2.0:1788612608.439859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612608.439996:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396544 00000100:00100000:0.0:1788612608.440005:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396544 00000100:00100000:0.0:1788612608.440058:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1788612608.440068:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:12363:x1875495914396544:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612608.440085:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612608.440102:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22405 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.440132:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.440141:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612608.440145:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612608.440158:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.440191:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.440205:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612608.440219:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932281600:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612608.440318:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612608.447210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.447587:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932281600:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612608.447632:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.447654:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897a00, rc 0) 00000100:00100000:1.0:1788612608.447702:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:12363:x1875495914396544:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 7635us (7851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612608.447711:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1788612608.449680:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396672 00000100:00100000:3.0:1788612608.449692:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396672 00010000:00010000:3.0:1788612608.449868:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.449951:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1788612608.449960:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9281850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914396672:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612608.449975:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612608.449995:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.450007:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.450028:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8cd9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223fe expref: 9 pid: 8439 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.450042:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612608.450046:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612608.450053:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.450063:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.450095:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.450108:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1875495932281728:192.168.203.30@tcp:105: 00000100:00100000:3.0:1788612608.450205:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612608.453830:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1875495932281728:192.168.203.30@tcp:105: 00010000:00010000:3.0:1788612608.453859:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612608.453957:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9281850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914396672:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3994us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612608.453968:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:2.0:1788612608.457989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.458138:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396800 00000100:00100000:3.0:1788612608.458148:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396800 00002000:00100000:3.0:1788612608.458195:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9611c6ad9500 x1875495914396800/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:254/0 lens 504/0 e 0 to 0 dl 1788612619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612608.458205:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6ad9500 with x1875495914396800 ext(0->8) 00002000:00010000:3.0:1788612608.458210:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c6ad9500 00000100:00100000:3.0:1788612608.459554:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788612608.459582:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914396800:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788612608.464721:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2395:x1875495914396800:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 5134us (6731us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788612608.464736:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00002000:00100000:2.0:1788612608.464750:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9611c6ad9500 x1875495914396800/t4294967315(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:254/0 lens 504/448 e 0 to 0 dl 1788612619 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612608.464759:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c6ad9500 with x1875495914396800 ext(0->8) 00002000:00010000:2.0:1788612608.464765:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c6ad9500 00000100:00100000:2.0:1788612608.485603:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.485877:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396928 00000100:00100000:3.0:1788612608.485887:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396928 00000100:00100000:3.0:1788612608.485956:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1788612608.485967:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12363:x1875495914396928:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788612608.496939:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788612608.496953:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788612608.496992:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788612608.497014:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788612608.497023:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788612608.497070:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497082:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497091:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497097:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612608.497101:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497109:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497154:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612608.497158:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612608.497163:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497169:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8b74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497186:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497192:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497197:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497201:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612608.497204:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497209:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497215:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612608.497218:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612608.497220:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497225:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8bba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497245:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497250:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497255:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497260:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612608.497263:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497268:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497275:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:0.0:1788612608.497278:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788612608.497280:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.497286:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8cbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.497847:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12363:x1875495914396928:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 11876us (12247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.497858:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:1.0:1788612608.498274:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612608.498301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932281856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788612608.498368:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612608.498553:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932281856 00000100:00100000:3.0:1788612608.498568:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932281856 00000100:00100000:3.0:1788612608.498611:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612608.498619:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932281856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788612608.498721:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788612608.498725:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788612608 00002000:00010000:3.0:1788612608.498727:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788612608.498738:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788612608 -> 1788612608 00002000:00010000:3.0:1788612608.498740:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788612608.498775:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932281856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (413us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788612608.498781:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1788612608.498818:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c81fed80/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788612608.498823:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932281856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788612608.506570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.506808:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397056 00000100:00100000:3.0:1788612608.506820:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397056 00000100:00100000:3.0:1788612608.506887:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1788612608.506897:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2394:x1875495914397056:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788612608.515879:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788612608.515890:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788612608.516367:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914397056:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 9459us (9804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612608.516379:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1788612608.521213:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.521325:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397312 00000100:00100000:1.0:1788612608.521345:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397312 00000100:00100000:1.0:1788612608.521541:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:1.0:1788612608.521553:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12363:x1875495914397312:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612608.521620:0:8253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612608.521646:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8cd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f7 expref: 19 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.521668:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.521673:0:8253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612608.521703:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.521745:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.521756:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612608.521880:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d486bc86 reply state 00000000f686123b transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.521893:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.521899:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.521902:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612608.521904:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612608.522017:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12363:x1875495914397312:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 465us (814us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788612608.522024:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:1.0:1788612608.529038:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.529136:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397440 00000100:00100000:3.0:1788612608.529147:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397440 00000100:00100000:3.0:1788612608.529233:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612608.529244:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914397440:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788612608.529500:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788612608.529504:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788612608 -> 1788612607 00002000:00010000:3.0:1788612608.529506:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788612606 00002000:00010000:3.0:1788612608.529508:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788612608 -> 1788612607 00002000:00010000:3.0:1788612608.529510:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788612608.529571:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914397440:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 328us (540us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788612608.529579:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612608.531702:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612608.531914:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397696 00000100:00100000:0.0:1788612608.531922:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397696 00000100:00100000:0.0:1788612608.531981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:0.0:1788612608.531990:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:12363:x1875495914397696:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788612608.532050:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.532068:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.532078:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.532109:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.532123:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 20 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612608.532148:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932281984:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612608.532226:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612608.536133:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932281984:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612608.536172:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612608.536523:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.539181:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397824 00000100:00100000:1.0:1788612608.539194:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397824 00010000:00010000:1.0:1788612608.539241:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 21 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.539286:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:1.0:1788612608.539296:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:2394:x1875495914397824:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612608.539309:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612608.539316:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 21 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539348:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 21 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539372:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b800/0x1f8616bf0bc8cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223e9 expref: 21 pid: 6523 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539389:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.539395:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539405:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539413:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539440:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612608.539522:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:2394:x1875495914397824:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 227us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612608.539529:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00010000:00010000:1.0:1788612608.539648:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539657:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539693:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539709:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539715:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539721:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612608.539725:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539733:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539742:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.539745:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788612608.539749:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.539768:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8cee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.539816:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12363:x1875495914397696:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 7826us (8121us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788612608.539825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:0.0:1788612608.545019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.549821:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397952 00000100:00100000:1.0:1788612608.549836:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397952 00000100:00100000:1.0:1788612608.549901:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:1.0:1788612608.549911:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914397952:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788612608.549950:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.549979:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.549988:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612608.549993:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612608.549998:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.550033:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.550047:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.550062:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961301804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932282112:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612608.550150:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54300 going to sleep for 11 seconds 00000100:00100000:1.0:1788612608.557106:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.557418:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398080 00000100:00100000:3.0:1788612608.557427:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398080 00010000:00010000:3.0:1788612608.557466:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 9 pid: 8440 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.557531:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:3.0:1788612608.557542:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914398080:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612608.557557:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612608.557597:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 9 pid: 8440 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.557612:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 9 pid: 8440 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.557638:0:10342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612608.557643:0:10342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612608.557649:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.557661:0:10342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.557699:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612608.557984:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914398080:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 442us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.557992:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00010000:00010000:0.0:1788612608.558175:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e67f65/0x1f8616bf0bc8ce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22405 expref: 8 pid: 8440 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612608.558191:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961301804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875495932282112:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612608.558213:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558233:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558240:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558260:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558268:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558275:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558281:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799be00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612608.558286:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558294:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558306:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612608.558322:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000217aa4a0/0x1f8616bf0bc8cf5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612608.558402:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914397952:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 8492us (13391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612608.558410:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788612608.564425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.564709:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398336 00000100:00100000:3.0:1788612608.564728:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398336 00000100:00100000:3.0:1788612608.564817:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 201 00000100:00100000:3.0:1788612608.564827:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12363:x1875495914398336:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788612608.564915:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.564934:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.564943:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.564979:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.564993:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 19 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.565007:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932282240:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612608.565097:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612608.569081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.569132:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398464 00000100:00100000:3.0:1788612608.569146:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398464 00010000:00010000:3.0:1788612608.569185:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 20 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.569219:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1788612608.569229:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:2394:x1875495914398464:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612608.569244:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612608.569251:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 20 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.569264:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 20 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.569285:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.569290:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.569301:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.569309:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.569341:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612608.569396:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:2394:x1875495914398464:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 168us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.569403:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00010000:00010000:1.0:1788612608.570132:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8b43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2238e expref: 19 pid: 6525 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.570164:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932282240:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612608.570186:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570197:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570212:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570386:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570400:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570410:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570441:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.570455:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 19 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.570469:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932282368:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612608.570555:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612608.586524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612608.587589:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398592 00000100:00100000:2.0:1788612608.587600:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398592 00010000:00010000:2.0:1788612608.587642:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 20 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612608.587682:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:2.0:1788612608.587691:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:2395:x1875495914398592:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612608.587705:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612608.587713:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 20 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612608.587738:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 20 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612608.587760:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:2.0:1788612608.587766:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612608.587785:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612608.587793:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612608.587814:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612608.587883:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:2395:x1875495914398592:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 192us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612608.587890:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00010000:00010000:1.0:1788612608.594541:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8cc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223f0 expref: 19 pid: 6524 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.594565:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932282368:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612608.594591:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.594601:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.594613:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612608.594715:0:12327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788612608.594842:0:12327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788612608.594873:0:12327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788612608.594946:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12327:1875495932282496:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788612608.595012:0:12327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612608.595053:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612608.595353:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932282496 00000100:00100000:3.0:1788612608.595371:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932282496 00000100:00100000:3.0:1788612608.595418:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788612608.595426:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12327:x1875495932282496:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788612608.595525:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12327:x1875495932282496:12345-0@lo:1000:mdt00_004.0 Request processed in 99us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.595532:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788612608.595866:0:12327:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788612608.595873:0:12327:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c81fed80, transno 4294967316 00000100:00100000:1.0:1788612608.595892:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12327:1875495932282496:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788612608.596004:0:12327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788612608.596052:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12327:1875495932282624:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788612608.596082:0:12327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612608.596111:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612608.596159:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932282624 00000100:00100000:0.0:1788612608.596163:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932282624 00000100:00100000:0.0:1788612608.596194:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788612608.596201:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12327:x1875495932282624:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788612608.596292:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12327:x1875495932282624:12345-0@lo:1000:mdt00_004.0 Request processed in 91us (209us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788612608.596299:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788612608.596499:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12327:1875495932282624:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788612608.596529:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596538:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596545:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596551:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612608.596555:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596574:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596590:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.596592:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612608.596598:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596604:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d03 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596627:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596633:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596639:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596643:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612608.596646:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596652:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596659:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612608.596662:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612608.596664:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596678:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8c3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596701:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596715:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596736:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596761:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.596776:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 22 pid: 12327 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.596786:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932282752:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612608.596859:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612608.607252:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c78fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932282752:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612608.607281:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612608.608121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612608.608282:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398720 00000100:00100000:3.0:1788612608.608290:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398720 00010000:00010000:3.0:1788612608.608337:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 23 pid: 12327 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.608394:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:3.0:1788612608.608405:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:2395:x1875495914398720:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612608.608418:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612608.608425:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 23 pid: 12327 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608439:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 23 pid: 12327 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608460:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8c5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d223d4 expref: 23 pid: 12327 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608506:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.608511:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608521:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608530:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608553:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612608.608601:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:2395:x1875495914398720:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 197us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612608.608608:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00010000:00010000:3.0:1788612608.608631:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608639:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608651:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608659:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608667:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608673:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.608683:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608692:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608701:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.608704:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612608.608708:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608716:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8d0a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608746:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608753:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608759:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608764:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612608.608767:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608772:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608778:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612608.608781:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612608.608789:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612608.608795:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8cfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612608.608922:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12363:x1875495914398336:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 44096us (44566us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788612608.608931:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 201 00000020:00080000:3.0:1788612608.608935:0:12327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788612608.609031:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612608.609036:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612608.609600:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788612608.609608:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612608.613899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612608.613941:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398976 00000100:00100000:1.0:1788612608.613950:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398976 00000100:00100000:1.0:1788612608.614001:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1788612608.614009:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12363:x1875495914398976:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788612608.614279:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788612608.614326:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788612608.614857:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.614875:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.614887:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.614895:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.614902:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.614908:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.614924:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788612608.615012:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:12363:x1875495914398976:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 1001us (1121us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788612608.615020:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000020:00080000:1.0:1788612608.615024:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788612608.615072:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612608.615078:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.615085:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612608.615089:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.615110:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.615122:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:1.0:1788612608.615125:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788612608.615129:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.615135:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d11 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612608.615158:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612608.615160:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612608.615161:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612609.071591:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612609.071601:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612609.071627:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788612609.071632:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612609.217165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.217225:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399232 00000100:00100000:1.0:1788612609.217234:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399232 00000100:00100000:1.0:1788612609.217336:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:1.0:1788612609.217346:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:12377:x1875495914399232:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612609.217383:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612609.217404:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2240c expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.217519:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8d1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.217547:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8d1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.217561:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8d1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612609.217572:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788612609.217681:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2240c expref: 26 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.217696:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8d1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2240c expref: 25 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.217704:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612609.217707:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612609.217711:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a400, rc 0) 00000100:00100000:1.0:1788612609.217764:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:12377:x1875495914399232:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 420us (609us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788612609.217771:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:1.0:1788612609.235592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.236453:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399360 00000100:00100000:3.0:1788612609.236465:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399360 00000100:00100000:3.0:1788612609.236543:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:3.0:1788612609.236553:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c78fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:12377:x1875495914399360:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788612609.236623:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.236641:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.236653:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.236667:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.236685:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.236692:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.237866:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.237882:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.237890:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612609.237939:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.237953:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238190:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238200:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238205:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.238210:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238218:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238239:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612609.238242:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.238248:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238254:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238267:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238274:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238279:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238285:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.238287:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238293:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238300:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.238303:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.238306:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238311:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238347:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238354:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238361:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238366:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.238369:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238836:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238846:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6f00) 00010000:00010000:3.0:1788612609.238848:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.238851:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.238857:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.239080:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c78fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:12377:x1875495914399360:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 2524us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.239090:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:1.0:1788612609.284085:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.284431:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399616 00000100:00100000:3.0:1788612609.284442:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399616 00000100:00100000:3.0:1788612609.284552:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:3.0:1788612609.284575:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d8192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:12380:x1875495914399616:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612609.284592:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.284609:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22413 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284666:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284678:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284687:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284696:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284701:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284705:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284812:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284819:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284826:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612609.284846:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788612609.284941:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284950:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284957:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284964:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.284969:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284977:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.284989:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612609.284993:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.284998:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285004:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285017:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285023:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285039:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285044:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.285047:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285053:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285061:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6f00) 00010000:00010000:3.0:1788612609.285063:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.285066:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285076:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285125:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285138:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.285144:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.285146:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612609.285149:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240600, rc 0) 00000100:00100000:3.0:1788612609.285386:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d8192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12380:x1875495914399616:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 812us (1311us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788612609.285399:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:1.0:1788612609.289057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.289379:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399744 00000100:00100000:3.0:1788612609.289391:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399744 00000100:00100000:3.0:1788612609.289456:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:3.0:1788612609.289468:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12380:x1875495914399744:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1788612609.289586:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289603:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289618:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289653:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289660:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289668:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289673:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.289677:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289685:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289696:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.289712:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612609.289718:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.289725:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.289805:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12380:x1875495914399744:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 339us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.289813:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:1.0:1788612609.293749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612609.293842:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400000 00000100:00100000:0.0:1788612609.293851:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400000 00000100:00100000:0.0:1788612609.293907:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1788612609.293918:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12380:x1875495914400000:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788612609.294398:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:12380:x1875495914400000:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 480us (656us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788612609.294407:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:1.0:1788612609.320275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.320386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400256 00000100:00100000:3.0:1788612609.320398:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400256 00000100:00100000:3.0:1788612609.320458:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:3.0:1788612609.320471:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:11912:x1875495914400256:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612609.320642:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.320664:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2241a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.320772:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.320787:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.320795:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.320827:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.320858:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 29 pid: 12327 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.320872:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932282880:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612609.321181:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612609.326946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612609.327385:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400384 00000100:00100000:2.0:1788612609.327395:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400384 00010000:00010000:2.0:1788612609.327437:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 30 pid: 12327 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.327446:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932282880:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612609.327581:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:2.0:1788612609.327591:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:2394:x1875495914400384:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612609.327607:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612609.327616:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 30 pid: 12327 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.327630:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 30 pid: 12327 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.327649:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.327794:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22413 expref: 30 pid: 12327 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.327830:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612609.327835:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.327845:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.327853:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.327880:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612609.327988:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:2394:x1875495914400384:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 397us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612609.327997:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00010000:00010000:1.0:1788612609.328004:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.328023:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612609.328042:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788612609.328262:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bc8d6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.328279:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.328287:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612609.328290:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612609.328293:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:1.0:1788612609.328707:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:11912:x1875495914400256:12345-192.168.203.30@tcp:101:bash.0 Request processed in 8237us (8441us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788612609.328715:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:1.0:1788612609.330861:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.331363:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400512 00000100:00100000:3.0:1788612609.331373:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400512 00000100:00100000:3.0:1788612609.331431:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:3.0:1788612609.331442:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:11912:x1875495914400512:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612609.331468:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.331512:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22421 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.331544:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.331557:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.331568:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.331675:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8d81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22421 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.331700:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22421 expref: 30 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.331708:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.331710:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612609.331726:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:3.0:1788612609.332091:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11912:x1875495914400512:12345-192.168.203.30@tcp:101:bash.0 Request processed in 650us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.332099:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:0.0:1788612609.334743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.334828:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400768 00000100:00100000:3.0:1788612609.334840:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400768 00000100:00100000:3.0:1788612609.334912:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:3.0:1788612609.334922:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:11912:x1875495914400768:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1788612609.335172:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.335188:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.335199:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612609.335239:0:8253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788612609.335259:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aa2e139 reply state 00000000d5d8a410 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.335273:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.335297:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.335300:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612609.335304:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788612609.335354:0:8253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1788612609.335465:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:11912:x1875495914400768:12345-192.168.203.30@tcp:36:bash.0 Request processed in 544us (731us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788612609.335473:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000020:00080000:3.0:1788612609.335514:0:8253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788612609.341867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.341950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400896 00000100:00100000:3.0:1788612609.341960:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400896 00000100:00100000:3.0:1788612609.342022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:3.0:1788612609.342032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+34:11912:x1875495914400896:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612609.342055:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.342075:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8d96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22428 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.342156:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8d96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22428 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.342173:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8d96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22428 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.342194:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.342198:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612609.342201:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241400, rc 0) 00000100:00100000:3.0:1788612609.342265:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:11912:x1875495914400896:12345-192.168.203.30@tcp:101:bash.0 Request processed in 234us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.342289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:0.0:1788612609.345944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.346046:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401024 00000100:00100000:1.0:1788612609.346055:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401024 00000100:00100000:1.0:1788612609.346121:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1788612609.346132:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:11912:x1875495914401024:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612609.346155:0:8543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612609.346175:0:8543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2242f expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612609.346200:0:8543:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c0fff, atime: 0x6a9c0ffe, ctime: 0x6a9c0fff, blocks: 0x8 00010000:00010000:1.0:1788612609.346232:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1788612609.346237:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612609.346245:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 8 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.346263:0:8543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 8 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.346275:0:8543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b800, rc 0) 00000100:00100000:1.0:1788612609.346344:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:11912:x1875495914401024:12345-192.168.203.30@tcp:101:bash.0 Request processed in 213us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612609.346350:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1788612609.351248:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612609.351682:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401152 00000100:00100000:2.0:1788612609.351693:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401152 00002000:00010000:2.0:1788612609.351736:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788612609.351740:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c79be680 with x1875495914401152 ext(0->18446744073709551615) 00002000:00010000:2.0:1788612609.351753:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c79be680. 00000100:00100000:2.0:1788612609.351795:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1788612609.351805:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2396:x1875495914401152:12345-192.168.203.30@tcp:10:bash.0 00002000:00010000:2.0:1788612609.352068:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788612609.352072:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788612607 -> 1788612609 00002000:00010000:2.0:1788612609.352074:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788612606 -> 1788612606 00002000:00010000:2.0:1788612609.352077:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788612607 -> 1788612609 00002000:00010000:2.0:1788612609.352078:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788612609.352388:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2396:x1875495914401152:12345-192.168.203.30@tcp:10:bash.0 Request processed in 583us (1149us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788612609.352398:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00002000:00010000:2.0:1788612609.352402:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788612609.352405:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c79be680 with x1875495914401152 ext(0->18446744073709551615) 00002000:00010000:2.0:1788612609.352410:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c79be680. 00010000:00010000:0.0:1788612609.396137:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612609.405899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.406052:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401280 00000100:00100000:3.0:1788612609.406064:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401280 00000100:00100000:3.0:1788612609.406126:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:3.0:1788612609.406137:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12394:x1875495914401280:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788612609.406436:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.406453:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.406465:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.414935:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.414960:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415025:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415126:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415295:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415304:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612609.415369:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415382:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415388:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415414:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415421:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612609.415425:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415432:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415444:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:2.0:1788612609.415447:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612609.415451:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415458:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc8da4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415706:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415725:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415732:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415746:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612609.415749:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415765:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415774:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6f00) 00010000:00010000:2.0:1788612609.415776:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612609.415779:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415785:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc8dab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415804:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415810:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415816:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415821:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612609.415824:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415829:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415836:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612609.415838:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612609.415841:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.415858:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36800/0x1f8616bf0bc8db2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612609.415956:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12394:x1875495914401280:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 9817us (10060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612609.415966:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:0.0:1788612609.472187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.472285:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401536 00000100:00100000:1.0:1788612609.472294:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401536 00000100:00100000:1.0:1788612609.472363:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00100000:1.0:1788612609.472373:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+35:12397:x1875495914401536:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612609.472394:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612609.472415:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8db9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22436 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472567:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472582:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472593:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472626:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472634:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472641:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472847:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8dce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472857:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472865:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612609.472874:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788612609.472945:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472952:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472959:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472964:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612609.472968:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472986:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.472998:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612609.473000:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612609.473005:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473011:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8dc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473024:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473031:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473036:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473041:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612609.473044:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473049:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473057:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:1.0:1788612609.473059:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612609.473062:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473079:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8dc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473120:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8db9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22436 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473134:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8dce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22436 expref: 37 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.473141:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612609.473143:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788612609.473145:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a600, rc 0) 00000100:00100000:1.0:1788612609.473251:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12397:x1875495914401536:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 878us (1073us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788612609.473258:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00100000:0.0:1788612609.479582:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.479665:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401664 00000100:00100000:1.0:1788612609.479676:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401664 00000100:00100000:1.0:1788612609.479746:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:1.0:1788612609.479758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12397:x1875495914401664:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1788612609.479829:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.479846:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.479856:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.479906:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.479919:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 37 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612609.479932:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932283008:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612609.480024:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612609.483405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.483513:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401920 00000100:00100000:3.0:1788612609.483522:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401920 00000100:00100000:3.0:1788612609.483568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612609.483578:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:6632:x1875495914401920:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788612609.483936:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:6632:x1875495914401920:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 357us (538us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788612609.483945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1788612609.484044:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875495932283008:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612609.484071:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.489598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.489706:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402048 00000100:00100000:3.0:1788612609.489847:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402048 00010000:00010000:3.0:1788612609.489892:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 39 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.489981:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:3.0:1788612609.489992:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:2395:x1875495914402048:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612609.490022:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612609.490030:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 39 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.490044:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 39 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.490066:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc8d73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2241a expref: 39 pid: 6524 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.490083:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.490089:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.490099:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.490106:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.490249:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612609.490316:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:2395:x1875495914402048:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 324us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.490334:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00010000:00010000:0.0:1788612609.491553:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491567:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491610:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491619:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491626:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491632:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799be00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612609.491636:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491644:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491659:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:0.0:1788612609.491662:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612609.491666:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.491691:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.492092:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12397:x1875495914401664:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 12332us (12516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612609.492102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:0.0:1788612609.494825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.494897:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402304 00000100:00100000:3.0:1788612609.494907:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402304 00000100:00100000:3.0:1788612609.494963:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612609.494973:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+37:12397:x1875495914402304:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612609.495217:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:12397:x1875495914402304:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 245us (400us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788612609.495225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1788612609.607949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612609.608103:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402560 00000100:00100000:2.0:1788612609.608114:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402560 00000100:00100000:2.0:1788612609.608182:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:2.0:1788612609.608193:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+38:12408:x1875495914402560:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1788612609.608218:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612609.608238:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8de3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2243d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608313:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608337:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608349:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608364:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608371:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608397:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608548:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8df8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608558:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608565:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612609.608575:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788612609.608651:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608658:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608664:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608670:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612609.608674:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608682:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608695:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:2.0:1788612609.608697:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612609.608709:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608715:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8dea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608729:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608903:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608911:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608917:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612609.608920:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608927:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608936:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c8ef5e00) 00010000:00010000:2.0:1788612609.608938:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612609.608942:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608948:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8df1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.608996:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8de3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2243d expref: 41 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.609023:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8df8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2243d expref: 40 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.609030:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612609.609033:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612609.609035:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36600, rc 0) 00000100:00100000:2.0:1788612609.609163:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12408:x1875495914402560:12345-192.168.203.30@tcp:101:cat.0 Request processed in 971us (1224us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788612609.609171:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:2.0:1788612609.613944:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.614094:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402816 00000100:00100000:1.0:1788612609.614105:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402816 00000100:00100000:1.0:1788612609.614173:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1788612609.614183:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+40:12408:x1875495914402816:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:1.0:1788612609.614503:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+41:12408:x1875495914402816:12345-192.168.203.30@tcp:35:cat.0 Request processed in 293us (540us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788612609.614513:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1788612609.631556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.631705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403072 00000100:00100000:1.0:1788612609.631716:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403072 00000100:00100000:1.0:1788612609.631993:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:1.0:1788612609.632004:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+41:12409:x1875495914403072:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:1.0:1788612609.632061:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788612609.632089:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241400/0x1f8616bf0bc8d96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22428 expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632123:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8df8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2243d expref: 40 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632149:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc8dce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22436 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632160:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240a00/0x1f8616bf0bc8d88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22421 expref: 38 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632169:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612609.632174:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612609.632194:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632207:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632216:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632230:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632237:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632244:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632336:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632345:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632351:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612609.632830:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788612609.632842:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424016364819ns, next at 425016361899ns, rc = 0 00010000:00010000:1.0:1788612609.632886:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632895:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632902:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632909:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632915:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632922:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.632980:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612609.632998:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633011:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633017:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633022:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612609.633026:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633034:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633044:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:1.0:1788612609.633047:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788612609.633051:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633056:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8e14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633070:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633076:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633082:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633086:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612609.633093:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633099:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633107:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612609.633109:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612609.633112:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633118:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8e06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612609.633140:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f540408 reply state 0000000062bb95c8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633152:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.633158:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:1.0:1788612609.633160:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612609.633163:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612609.633243:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:12409:x1875495914403072:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1239us (1694us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788612609.633251:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00010000:00010000:3.0:1788612609.638455:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612609.638472:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.638522:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612609.638528:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.638539:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.638557:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:3.0:1788612609.638560:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612609.638564:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.638570:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8e1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.638668:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612609.638671:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612609.638673:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612609.684790:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612609.684891:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403328 00000100:00100000:0.0:1788612609.684902:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403328 00000100:00100000:0.0:1788612609.684968:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:0.0:1788612609.684979:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+39:12415:x1875495914403328:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612609.685005:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612609.685027:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8e22 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22444 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685159:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685174:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685184:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685195:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685202:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685224:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612609.685597:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788612609.685736:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685746:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685754:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685785:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685792:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685799:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685805:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612609.685810:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685818:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685830:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:0.0:1788612609.685832:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612609.685844:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685851:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8e29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612609.685864:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003087dce0 reply state 00000000ce7352a4 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685875:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685881:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:0.0:1788612609.685883:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612609.685885:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788612609.685914:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8e22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685930:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.685937:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612609.685939:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612609.685942:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897400, rc 0) 00000100:00100000:0.0:1788612609.686000:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:12415:x1875495914403328:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1023us (1222us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788612609.686008:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:0.0:1788612609.691768:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.691854:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403456 00000100:00100000:3.0:1788612609.691864:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403456 00000100:00100000:3.0:1788612609.691940:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788612609.691951:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914403456:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612609.691968:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.692002:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2244b expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612609.692027:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612609.692047:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1788612609.692052:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612609.692062:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.692080:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.692093:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:3.0:1788612609.692169:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914403456:12345-192.168.203.30@tcp:101:bash.0 Request processed in 220us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.692176:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00080000:0.0:1788612609.692426:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612609.695406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612609.695507:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403584 00000100:00100000:0.0:1788612609.695531:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403584 00000100:00100000:0.0:1788612609.695593:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1788612609.695603:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:12415:x1875495914403584:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612609.695623:0:8543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612609.695641:0:8543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22452 expref: -99 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.695673:0:8543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.695681:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612609.695686:0:8543:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612609.695690:0:8543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 9 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.695764:0:8543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.695778:0:8543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 9 pid: 8441 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.695790:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932283136:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612609.695886:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612609.699144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.699234:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403712 00000100:00100000:1.0:1788612609.699243:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403712 00010000:00010000:1.0:1788612609.699301:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 10 pid: 8441 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612609.699358:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:1.0:1788612609.699368:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2394:x1875495914403712:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612609.699382:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612609.699405:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 10 pid: 8441 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.699419:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 10 pid: 8441 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.699444:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612609.699448:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612609.699458:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 10 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.699468:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 10 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.699545:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 10 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612609.699559:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1875495932283264:192.168.203.30@tcp:105: 00000100:00100000:1.0:1788612609.699633:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612609.701697:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7883b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1875495932283264:192.168.203.30@tcp:105: 00010000:00010000:3.0:1788612609.701733:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612609.701880:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2394:x1875495914403712:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2511us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.701890:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00010000:00010000:0.0:1788612609.703175:0:8543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0ab67c/0x1f8616bf0bc8e45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2244b expref: 9 pid: 8441 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.703219:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8543:1875495932283136:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612609.703251:0:8543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 8 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.703268:0:8543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897c00, rc 0) 00000100:00100000:0.0:1788612609.703343:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:12415:x1875495914403584:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7742us (7946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612609.703352:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:1.0:1788612609.705892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.706000:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403968 00000100:00100000:3.0:1788612609.706011:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403968 00000100:00100000:3.0:1788612609.706068:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1788612609.706078:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+42:12415:x1875495914403968:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1788612609.706436:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12415:x1875495914403968:12345-192.168.203.30@tcp:35:bash.0 Request processed in 358us (555us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788612609.706451:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1788612609.836463:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.836586:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404096 00000100:00100000:3.0:1788612609.836596:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404096 00000100:00100000:3.0:1788612609.836663:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:3.0:1788612609.836675:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+43:12431:x1875495914404096:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612609.836700:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.836725:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22459 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.836802:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8e5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.836819:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.836831:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612609.836876:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788612609.836879:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612609.836897:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8e5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.836919:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22459 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.836937:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8e5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22459 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.836964:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612609.836967:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612609.836971:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240800, rc 0) 00000100:00100000:3.0:1788612609.837038:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:12431:x1875495914404096:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 365us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.837045:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:1.0:1788612609.847365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.848907:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404352 00000100:00100000:3.0:1788612609.848920:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404352 00000100:00100000:3.0:1788612609.849093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:3.0:1788612609.849105:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+44:12431:x1875495914404352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612609.849125:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612609.849146:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8e61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22460 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.849253:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.849269:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.849280:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612609.849291:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788612609.849411:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8e61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22460 expref: 47 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.849455:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8e68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22460 expref: 46 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.849463:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:3.0:1788612609.849466:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612609.849469:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240000, rc 0) 00000100:00100000:3.0:1788612609.849558:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+46:12431:x1875495914404352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 455us (2201us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788612609.849566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:0.0:1788612609.857080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612609.857140:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.857243:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404736 00000100:00100000:1.0:1788612609.857255:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404736 00000100:00100000:1.0:1788612609.857329:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1788612609.857341:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+46:2394:x1875495914404736:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612609.857356:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612609.857380:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8e68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22460 expref: 46 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.857402:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:1.0:1788612609.857407:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612609.857522:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+45:2394:x1875495914404736:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 183us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612609.857532:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612609.857699:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404608 00000100:00100000:2.0:1788612609.857704:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404608 00000100:00100000:2.0:1788612609.857750:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:2.0:1788612609.857758:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+45:12431:x1875495914404608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612609.857775:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612609.857791:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8e76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22467 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.857889:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8e7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.857903:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8e7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.857914:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8e7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612609.857941:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788612609.858032:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36a00/0x1f8616bf0bc8e76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22467 expref: 48 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.858047:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8e7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22467 expref: 47 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.858054:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:2.0:1788612609.858057:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788612609.858059:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36000, rc 0) 00000100:00100000:2.0:1788612609.858084:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:12431:x1875495914404608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 328us (1014us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788612609.858090:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1788612609.868988:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.869093:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404864 00000100:00100000:3.0:1788612609.869104:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404864 00000100:00100000:3.0:1788612609.869201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1788612609.869225:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2397:x1875495914404864:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:3.0:1788612609.869272:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.869311:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 8 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.869334:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612609.869339:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612609.869344:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.869390:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 8 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.869419:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 8 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.869434:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875495932283392:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612609.869695:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612609.875170:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875495932283392:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612609.875200:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.875802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612609.876064:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404992 00000100:00100000:2.0:1788612609.876073:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404992 00002000:00100000:2.0:1788612609.876119:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9611c7b4dc00 x1875495914404992/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:255/0 lens 504/0 e 0 to 0 dl 1788612620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612609.876139:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c7b4dc00 with x1875495914404992 ext(0->8) 00010000:00010000:2.0:1788612609.876148:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 9 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.876164:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 9 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612609.876172:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c7b4dc00 00000100:00100000:2.0:1788612609.876205:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1788612609.876231:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2395:x1875495914404992:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:2.0:1788612609.879454:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:2395:x1875495914404992:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 3215us (3644us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788612609.879469:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:2.0:1788612609.879509:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9611c7b4dc00 x1875495914404992/t4294967309(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:255/0 lens 504/448 e 0 to 0 dl 1788612620 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612609.879520:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c7b4dc00 with x1875495914404992 ext(0->8) 00010000:00010000:2.0:1788612609.879530:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 11 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612609.879548:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 11 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612609.879566:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9611c7b4dc00 00000100:00100000:0.0:1788612609.883027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.883111:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405120 00000100:00100000:3.0:1788612609.883121:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405120 00010000:00010000:3.0:1788612609.883169:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 11 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.883213:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:3.0:1788612609.883223:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:2396:x1875495914405120:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612609.883237:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788612609.883255:0:10342:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788612609.883258:0:10342:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788612609 00002000:00010000:3.0:1788612609.883260:0:10342:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788612609 00002000:00010000:3.0:1788612609.883263:0:10342:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788612609 00002000:00010000:3.0:1788612609.883265:0:10342:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788612609.883272:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 11 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.883316:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 11 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.883350:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e96c550/0x1f8616bf0bc8e4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22452 expref: 11 pid: 8543 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.883369:0:10342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612609.883374:0:10342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612609.883381:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.883391:0:10342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.883426:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612609.883539:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2396:x1875495914405120:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 317us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.883547:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00010000:00010000:0.0:1788612609.883758:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883768:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883788:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883796:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883817:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883824:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612609.883827:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883836:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883849:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.883857:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc8e8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.883916:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2397:x1875495914404864:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 14706us (14938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612609.883924:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1788612609.889087:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.889305:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405376 00000100:00100000:3.0:1788612609.889315:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405376 00000100:00100000:3.0:1788612609.889382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1788612609.889392:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+47:12431:x1875495914405376:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:3.0:1788612609.889456:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8e7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22467 expref: 47 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612609.889933:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788612609.889968:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788612609.890331:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1788612609.890375:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.890389:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.890398:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.890432:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.890446:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 51 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.890460:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875495932283520:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612609.890903:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67eca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612609.894317:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875495932283520:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612609.894358:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.896088:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.896415:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405504 00000100:00100000:3.0:1788612609.896425:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405504 00010000:00010000:3.0:1788612609.896467:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 52 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.896844:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:3.0:1788612609.896855:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+52:2395:x1875495914405504:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612609.896871:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612609.896879:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 52 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.896892:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 52 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.896918:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bc8e37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22444 expref: 52 pid: 6523 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.896934:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:3.0:1788612609.896939:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.896948:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.896955:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.896989:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612609.897051:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+51:2395:x1875495914405504:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 197us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.897058:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00010000:00010000:0.0:1788612609.897114:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.897123:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612609.897240:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788612609.897381:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788612609.897470:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932283648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788612609.897581:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612609.897620:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612609.898018:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932283648 00000100:00100000:1.0:1788612609.898027:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932283648 00000100:00100000:1.0:1788612609.898216:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788612609.898227:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875495932283648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788612609.898413:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612609.899639:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875495932283648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1410us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612609.899650:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788612609.899987:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932283648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788612609.900187:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788612609.900257:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932283776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788612609.900369:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612609.900397:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1788612609.900413:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932283776 00000100:00100000:2.0:1788612609.900420:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932283776 00000100:00100000:2.0:1788612609.900458:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788612609.900466:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6526:x1875495932283776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788612609.900651:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6526:x1875495932283776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 185us (281us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788612609.900658:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788612609.900682:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875495932283776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788612609.900795:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788612609.900828:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.900838:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.900846:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.900852:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612609.900856:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.900864:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.900894:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612609.900897:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788612609.900902:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612609.900908:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8e92 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612609.901001:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788612609.901060:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788612609.901071:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424284593820ns, next at 425284591462ns, rc = 0 00000001:00080000:0.0:1788612609.901077:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788612609.901101:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612609.901104:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788612609.901110:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc8e7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22467 expref: 55 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612609.901278:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:12431:x1875495914405376:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 11887us (12199us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788612609.901286:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000020:00080000:0.0:1788612609.902066:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788612609.904554:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612609.904842:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405632 00000100:00100000:1.0:1788612609.904853:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405632 00000100:00100000:1.0:1788612609.904912:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:1.0:1788612609.904922:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+54:12431:x1875495914405632:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612609.904944:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612609.904972:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8e99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2246e expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.905049:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8e99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2246e expref: 55 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.905063:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8e99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2246e expref: 55 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612609.905083:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612609.905086:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612609.905090:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b600, rc 0) 00000100:00100000:1.0:1788612609.905147:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:12431:x1875495914405632:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 226us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612609.905154:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:1.0:1788612609.912199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612609.912277:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405888 00000100:00100000:0.0:1788612609.912286:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405888 00000100:00100000:0.0:1788612609.912373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612609.912383:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+55:12431:x1875495914405888:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788612609.912648:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+56:12431:x1875495914405888:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 265us (458us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788612609.912669:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612609.985330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612609.985531:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406016 00000100:00100000:3.0:1788612609.985554:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406016 00000100:00100000:3.0:1788612609.985616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:3.0:1788612609.985628:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+56:12441:x1875495914406016:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788612609.985702:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985843:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985857:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985870:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985876:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985883:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985952:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985960:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.985966:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612609.986013:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986036:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986042:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986049:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986054:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.986058:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986065:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986079:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612609.986082:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.986087:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986092:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ea0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986106:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986113:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986119:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986187:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.986190:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986197:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986206:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:3.0:1788612609.986208:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.986211:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986217:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ea7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986227:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986232:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986238:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986243:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612609.986245:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986251:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986269:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612609.986271:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612609.986275:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612609.986280:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612609.986368:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+56:12441:x1875495914406016:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 742us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612609.986376:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:1.0:1788612610.022420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.022511:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406272 00000100:00100000:3.0:1788612610.022522:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406272 00000100:00100000:3.0:1788612610.022594:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:3.0:1788612610.022604:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+56:12444:x1875495914406272:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612610.022623:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612610.022642:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22475 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022716:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022731:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022757:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022768:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022791:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022799:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022900:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022908:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.022915:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612610.022923:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00080000:0.0:1788612610.023128:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612610.023225:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023232:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023239:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023244:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.023248:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023255:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023276:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612610.023279:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612610.023283:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023290:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8ebc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023304:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023310:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023316:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023333:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.023336:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023342:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023351:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:3.0:1788612610.023354:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612610.023358:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023365:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8ec3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023415:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8eb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023429:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.023435:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.023438:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612610.023441:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240c00, rc 0) 00000100:00100000:3.0:1788612610.023555:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:12444:x1875495914406272:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 951us (1236us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788612610.023564:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:1.0:1788612610.026216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.026327:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406400 00000100:00100000:3.0:1788612610.026336:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406400 00000100:00100000:3.0:1788612610.026451:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:3.0:1788612610.026462:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:12444:x1875495914406400:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1788612610.026620:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.026636:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.026648:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.026682:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.026706:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.026724:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.026731:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.027384:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.027396:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.027409:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.027412:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612610.027416:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.027423:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8ed8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.027532:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:12444:x1875495914406400:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 1070us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.027541:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:0.0:1788612610.030564:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.030653:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406656 00000100:00100000:3.0:1788612610.030663:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406656 00000100:00100000:3.0:1788612610.030870:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1788612610.030885:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+58:12444:x1875495914406656:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612610.031119:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:12444:x1875495914406656:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 237us (562us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788612610.031918:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1788612610.090109:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.092064:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406912 00000100:00100000:3.0:1788612610.092081:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406912 00000100:00100000:2.0:1788612610.092860:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:2.0:1788612610.092872:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:12454:x1875495914406912:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612610.092897:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612610.092901:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788612610.092942:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bc8e5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22459 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.093033:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:2.0:1788612610.093039:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612610.093055:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8edf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2247c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.093402:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.093417:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.093426:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.093459:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.093473:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 59 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.093534:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932283904:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612610.093683:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612610.100883:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932283904:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612610.100914:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.103859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.104981:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407040 00000100:00100000:3.0:1788612610.104991:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407040 00010000:00010000:3.0:1788612610.105033:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 60 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.105080:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:3.0:1788612610.105090:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:2394:x1875495914407040:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612610.105108:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612610.105116:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 60 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.105140:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 60 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.105160:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8eca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22475 expref: 60 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.105177:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.105181:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.105191:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.105199:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.105244:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612610.105307:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:2394:x1875495914407040:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 217us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.105314:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00010000:00010000:2.0:1788612610.105523:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.105533:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612610.105553:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788612610.105677:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc8edf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.105694:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.105702:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:2.0:1788612610.105704:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612610.105707:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36600, rc 0) 00000100:00100000:2.0:1788612610.105760:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:12454:x1875495914406912:12345-192.168.203.30@tcp:101:bash.0 Request processed in 12890us (15716us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788612610.105768:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:1.0:1788612610.108306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.108423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407168 00000100:00100000:0.0:1788612610.108432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407168 00000100:00100000:0.0:1788612610.108556:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:0.0:1788612610.108568:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+59:12454:x1875495914407168:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612610.108591:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612610.108613:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8ef4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22483 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.108645:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.108658:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.108668:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.108903:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc8ef4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.108921:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.108929:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612610.108940:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612610.108945:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897800, rc 0) 00000100:00100000:0.0:1788612610.109516:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:12454:x1875495914407168:12345-192.168.203.30@tcp:101:bash.0 Request processed in 948us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.109525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:1.0:1788612610.112035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.112198:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407424 00000100:00100000:3.0:1788612610.112208:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407424 00000100:00100000:3.0:1788612610.112415:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 225 00000100:00100000:3.0:1788612610.112425:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+60:12454:x1875495914407424:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1788612610.112663:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.112681:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.112692:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612610.112745:0:8253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1788612610.112766:0:8253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7f465aa reply state 00000000e4c68243 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.112778:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.112785:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.112788:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612610.112791:0:8253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612610.112877:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:12454:x1875495914407424:12345-192.168.203.30@tcp:36:bash.0 Request processed in 452us (927us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788612610.112894:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 225 00000020:00080000:3.0:1788612610.112898:0:8253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788612610.123419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.123517:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407552 00000100:00100000:3.0:1788612610.123527:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407552 00000100:00100000:3.0:1788612610.123582:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:3.0:1788612610.123592:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:12454:x1875495914407552:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788612610.123615:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612610.123638:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8f09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2248a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.124406:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.124426:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.124435:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.124471:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.124590:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 64 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.124604:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932284032:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612610.124907:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612610.130008:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612610.130144:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932284032:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612610.130170:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.130289:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407680 00000100:00100000:3.0:1788612610.130309:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407680 00010000:00010000:3.0:1788612610.130423:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 65 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.130561:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:3.0:1788612610.130572:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:2394:x1875495914407680:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612610.130586:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612610.130593:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 65 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.130606:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 65 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.130628:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc8ee6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2247c expref: 65 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.130643:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.130648:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.130657:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.130665:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.130689:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612610.130755:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+64:2394:x1875495914407680:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 184us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.130772:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00010000:00010000:0.0:1788612610.131287:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.131297:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612610.131366:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788612610.131371:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612610.131392:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.131423:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240200/0x1f8616bf0bc8f09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.131440:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.131448:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612610.131450:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612610.131453:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240400, rc 0) 00000100:00100000:0.0:1788612610.131514:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:12454:x1875495914407552:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7924us (8105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.131521:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:0.0:1788612610.134439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.135088:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407936 00000100:00100000:1.0:1788612610.135101:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407936 00000100:00100000:1.0:1788612610.135261:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1788612610.135273:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+63:12454:x1875495914407936:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:1.0:1788612610.135695:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+64:12454:x1875495914407936:12345-192.168.203.30@tcp:35:bash.0 Request processed in 423us (1262us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788612610.135728:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1788612610.200539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.200737:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408064 00000100:00100000:1.0:1788612610.200748:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408064 00000100:00100000:1.0:1788612610.200815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:1.0:1788612610.200827:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+64:12460:x1875495914408064:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612610.200851:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.200873:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22491 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.200939:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.200954:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.200965:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612610.201006:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788612610.201011:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612610.201029:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.201053:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22491 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.201071:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8f1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22491 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.201100:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612610.201102:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612610.201107:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799be00, rc 0) 00000100:00100000:1.0:1788612610.201186:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:12460:x1875495914408064:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 361us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.201193:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:0.0:1788612610.204630:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.204715:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408192 00000100:00100000:3.0:1788612610.204725:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408192 00000100:00100000:3.0:1788612610.204789:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:3.0:1788612610.204800:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:12460:x1875495914408192:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612610.204819:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612610.204839:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8f25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22498 expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.204902:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.204916:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.204938:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.204949:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.204957:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.204964:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205049:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205076:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205083:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612610.205125:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788612610.205130:0:8253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612610.205158:0:8253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205171:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205179:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205185:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205191:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205197:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.205201:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205208:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205219:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:3.0:1788612610.205222:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612610.205233:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205240:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc8f2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205461:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205469:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205524:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205530:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.205533:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205540:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205549:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:3.0:1788612610.205551:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612610.205555:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205560:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc8f33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205589:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc8f25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 67 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205614:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 66 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.205622:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.205624:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612610.205627:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240000, rc 0) 00000100:00100000:3.0:1788612610.205684:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12460:x1875495914408192:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 885us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.205692:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1788612610.214399:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.214445:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.214549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408448 00000100:00100000:1.0:1788612610.214559:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408448 00000100:00100000:1.0:1788612610.214611:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:1.0:1788612610.214621:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12460:x1875495914408448:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612610.214642:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.214665:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8f41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2249f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214774:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214789:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214798:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 67 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214807:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214838:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 67 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214864:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 67 pid: 8253 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.214877:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932284160:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612610.214976:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.214985:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.214997:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932284288:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612610.215034:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612610.215392:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408576 00000100:00100000:3.0:1788612610.215399:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408576 00010000:00010000:3.0:1788612610.215425:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 68 pid: 8253 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.215457:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1788612610.215465:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:2397:x1875495914408576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612610.215495:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612610.215502:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 68 pid: 8253 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.215515:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 68 pid: 8253 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.215533:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.215538:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.215554:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.215561:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612610.215591:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:2397:x1875495914408576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 127us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.215600:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00010000:00010000:1.0:1788612610.220741:0:6525:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.30@tcp) returned -22 from blocking AST (req@00000000b3278194 x1875495932284160) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 67 pid: 8253 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.220766:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bc8f3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22498 expref: 67 pid: 8253 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.220787:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932284160:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612610.220801:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875495932284288:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612610.220822:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612610.220827:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.220856:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.220866:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.221064:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.221128:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408704 00000100:00100000:3.0:1788612610.221136:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408704 00010000:00010000:3.0:1788612610.221179:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.221218:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:3.0:1788612610.221228:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:2395:x1875495914408704:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612610.221241:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612610.221247:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.221269:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.221289:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bc8f10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2248a expref: 67 pid: 6525 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.221301:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.221305:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.221331:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.221339:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.221369:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612610.221428:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:2395:x1875495914408704:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 201us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.221437:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00010000:00010000:0.0:1788612610.221625:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.221633:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612610.221650:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788612610.221763:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8f41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.221778:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.221784:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612610.221787:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612610.221790:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b200, rc 0) 00000100:00100000:0.0:1788612610.221834:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12460:x1875495914408448:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 7214us (7444us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788612610.221840:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:0.0:1788612610.223870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.223939:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408960 00000100:00100000:3.0:1788612610.223948:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408960 00000100:00100000:3.0:1788612610.224011:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1788612610.224022:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12460:x1875495914408960:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:3.0:1788612610.224036:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612610.224058:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b600/0x1f8616bf0bc8e99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2246e expref: 66 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.224077:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.224082:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612610.224136:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:12460:x1875495914408960:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.224231:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1788612610.230454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.233400:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409088 00000100:00100000:1.0:1788612610.233413:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409088 00000100:00100000:1.0:1788612610.233505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:1.0:1788612610.233516:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:12460:x1875495914409088:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:1.0:1788612610.233711:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.233731:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.233876:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612610.234058:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788612610.234410:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:12460:x1875495914409088:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 894us (3961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.234419:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:2.0:1788612610.239188:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.239386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409216 00000100:00100000:0.0:1788612610.239397:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409216 00000100:00100000:0.0:1788612610.239455:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:0.0:1788612610.239517:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+65:12460:x1875495914409216:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612610.239538:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612610.239559:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224a6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.239621:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.239636:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.239657:0:6524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.239671:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.239687:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612610.239690:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612610.239693:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.239700:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896a00, rc 0) 00000100:00100000:0.0:1788612610.239763:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12460:x1875495914409216:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 290us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.239769:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 231 00010000:00010000:0.0:1788612610.415795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612610.671887:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612610.671896:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612610.671923:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788612610.671934:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612610.672096:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932284416:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612610.672223:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67eccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612610.676347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.676469:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409344 00000100:00100000:0.0:1788612610.676527:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409344 00000100:00100000:0.0:1788612610.676603:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:0.0:1788612610.676615:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914409344:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612610.676650:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612610.676769:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914409344:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 157us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.676778:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:3.0:1788612610.677114:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932284416:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788612610.683279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612610.693588:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409472 00000100:00100000:2.0:1788612610.693604:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409472 00000100:00100000:2.0:1788612610.693685:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:2.0:1788612610.693696:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12461:x1875495914409472:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788612610.693768:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693785:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693799:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693814:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693822:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693828:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693850:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693859:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693865:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612610.693926:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788612610.693930:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612610.693942:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693953:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693959:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693966:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693972:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.693977:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693984:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.693995:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:2.0:1788612610.693999:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.694004:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694011:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8f64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694025:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694041:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694047:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694053:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.694056:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694062:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694069:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9612c8ef5e00) 00010000:00010000:2.0:1788612610.694072:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.694075:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694080:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8f6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694097:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694103:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694108:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694113:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.694122:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694128:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694136:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:2.0:1788612610.694139:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.694142:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.694147:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8f72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.694236:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12461:x1875495914409472:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 540us (10964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612610.694244:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:2.0:1788612610.698196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.698289:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409728 00000100:00100000:1.0:1788612610.698299:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409728 00000100:00100000:1.0:1788612610.698362:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:1.0:1788612610.698372:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+66:12461:x1875495914409728:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612610.698403:0:8253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.698459:0:8253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8f79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224ad expref: -99 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698594:0:8253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698610:0:8253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698622:0:8253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612610.698633:0:8253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788612610.698709:0:8253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698718:0:8253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698724:0:8253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698731:0:8253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612610.698735:0:8253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698743:0:8253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698756:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612610.698760:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788612610.698764:0:8253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698781:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8f80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698821:0:8253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8f79 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224ad expref: 68 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698833:0:8253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:1.0:1788612610.698835:0:8253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612610.698840:0:8253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8f79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224ad expref: 68 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.698850:0:8253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ae00, rc 0) 00000100:00100000:1.0:1788612610.698912:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914409728:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 541us (724us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1788612610.698919:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:3.0:1788612610.710958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.711131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409856 00000100:00100000:1.0:1788612610.711141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409856 00000100:00100000:1.0:1788612610.711201:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:1.0:1788612610.711210:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914409856:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612610.711242:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612610.711364:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914409856:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 155us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.711373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:2.0:1788612610.715951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.716048:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410112 00000100:00100000:0.0:1788612610.716057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410112 00000100:00100000:0.0:1788612610.716116:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:0.0:1788612610.716130:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914410112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612610.716150:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612610.716154:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788612610.716179:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8f1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22491 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.716199:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:0.0:1788612610.716204:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612610.716217:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8f8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224b4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612610.716598:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788612610.716714:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8f95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.716727:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.716748:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.716923:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bc8f8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224b4 expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.716937:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8f95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224b4 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.716945:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612610.716947:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612610.716950:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612610.717104:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:12461:x1875495914410112:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 979us (1160us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788612610.717111:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:3.0:1788612610.725298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.725388:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410368 00000100:00100000:0.0:1788612610.725398:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410368 00000100:00100000:0.0:1788612610.725464:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1788612610.725498:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:12461:x1875495914410368:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612610.725557:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612610.725587:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896000/0x1f8616bf0bc8f95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224b4 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725605:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9611c65f7900) 00010000:00010000:0.0:1788612610.725617:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612610.725637:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725664:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725674:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725726:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725735:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725742:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725795:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725802:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725809:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725815:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612610.725820:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725828:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725837:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:0.0:1788612610.725845:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612610.725850:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725856:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc8fa3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725867:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725873:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725878:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725883:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612610.725886:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725891:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725899:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9e2d2e4f (ffff9611c65f7100) 00010000:00010000:0.0:1788612610.725902:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612610.725905:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.725910:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bc8faa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9e2d2e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.725987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914410368:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 514us (697us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612610.726002:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1788612610.730816:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612610.730948:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410496 00000100:00100000:2.0:1788612610.730957:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410496 00000100:00100000:2.0:1788612610.731021:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:2.0:1788612610.731031:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+67:12461:x1875495914410496:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612610.731049:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612610.731072:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8fb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224bb expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.731118:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.731149:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.731160:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.731264:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc8fb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 69 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.731280:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 68 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.731288:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:2.0:1788612610.731291:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612610.731295:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37c00, rc 0) 00000100:00100000:2.0:1788612610.731369:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:12461:x1875495914410496:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 339us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612610.731376:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:2.0:1788612610.734020:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.734169:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410752 00000100:00100000:0.0:1788612610.734179:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410752 00000100:00100000:0.0:1788612610.734242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:0.0:1788612610.734252:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+68:12461:x1875495914410752:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612610.734344:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.734360:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.734371:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612610.734565:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788612610.734576:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425118099086ns, next at 426118095961ns, rc = 0 00000004:00010000:0.0:1788612610.734625:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007497c159 reply state 000000005c03801c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.734637:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.734646:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:0.0:1788612610.734649:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788612610.734653:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612610.734761:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+70:12461:x1875495914410752:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 502us (740us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788612610.734770:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:0.0:1788612610.738168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.738265:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410880 00000100:00100000:1.0:1788612610.738273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410880 00000100:00100000:1.0:1788612610.738335:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:1.0:1788612610.738360:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+70:12461:x1875495914410880:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612610.738384:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.738405:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.738462:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 71 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.738516:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 71 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.738539:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:1.0:1788612610.738543:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612610.738547:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ae00, rc 0) 00000100:00100000:1.0:1788612610.738600:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+71:12461:x1875495914410880:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 241us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.738607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:3.0:1788612610.742107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.742244:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411008 00000100:00100000:1.0:1788612610.742253:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411008 00000100:00100000:1.0:1788612610.742339:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:1.0:1788612610.742349:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914411008:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788612610.742577:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2394:x1875495914411008:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 229us (490us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788612610.742585:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00080000:0.0:1788612610.742900:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612610.746784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.746929:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411264 00000100:00100000:3.0:1788612610.746939:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411264 00000100:00100000:3.0:1788612610.746999:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612610.747009:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+71:12461:x1875495914411264:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612610.747237:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+72:12461:x1875495914411264:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 229us (461us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788612610.747246:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612610.750336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.750515:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411520 00000100:00100000:1.0:1788612610.750525:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411520 00000100:00100000:1.0:1788612610.750584:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:1.0:1788612610.750593:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+72:12461:x1875495914411520:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788612610.750715:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+72:12461:x1875495914411520:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 115us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.750723:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:0.0:1788612610.753656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.754011:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411648 00000100:00100000:1.0:1788612610.754021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411648 00000100:00100000:1.0:1788612610.754086:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:1.0:1788612610.754108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+72:12461:x1875495914411648:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612610.754240:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.754263:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8fcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.754343:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8fd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.754358:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.754371:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612610.754414:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612610.754432:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.754458:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc8fcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c9 expref: 74 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.754541:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c9 expref: 73 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.754549:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:1.0:1788612610.754553:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788612610.754557:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799be00, rc 0) 00000100:00100000:1.0:1788612610.754716:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+73:12461:x1875495914411648:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 612us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.754723:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:3.0:1788612610.757821:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.757891:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411776 00000100:00100000:1.0:1788612610.757903:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411776 00000100:00100000:1.0:1788612610.758339:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1788612610.758352:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+10:2395:x1875495914411776:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612610.758370:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.758389:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224d0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612610.758423:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c1002, blocks: 0x0 00010000:00010000:1.0:1788612610.758447:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788612610.758452:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612610.758461:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.758509:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.758912:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a600, rc 0) 00000100:00100000:1.0:1788612610.759358:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:2395:x1875495914411776:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.759367:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1788612610.763101:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.763252:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412032 00000100:00100000:3.0:1788612610.763261:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412032 00000100:00100000:3.0:1788612610.763371:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:3.0:1788612610.763382:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+73:12461:x1875495914412032:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788612610.763522:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+73:12461:x1875495914412032:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 141us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.763530:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:0.0:1788612610.766030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.766187:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412160 00000100:00100000:1.0:1788612610.766197:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412160 00000100:00100000:1.0:1788612610.766255:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:1.0:1788612610.766265:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+11:12461:x1875495914412160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612610.766284:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612610.766303:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224d7 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.766343:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.766351:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612610.766355:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612610.766360:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.766393:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.766408:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.766435:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875495932284544:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612610.766559:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612610.770219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.770412:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875495932284544:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612610.770445:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.770465:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b400, rc 0) 00000100:00100000:1.0:1788612610.770541:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:12461:x1875495914412160:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4277us (4520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.770550:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1788612610.771056:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412288 00000100:00100000:3.0:1788612610.771063:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412288 00010000:00010000:3.0:1788612610.771098:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.771187:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:3.0:1788612610.771196:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:2395:x1875495914412288:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612610.771209:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612610.771230:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.771243:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.771264:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc8fdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d0 expref: 12 pid: 8440 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.771276:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612610.771280:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612610.771288:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.771298:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.771341:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.771357:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875495932284672:192.168.203.30@tcp:105: 00000100:00100000:3.0:1788612610.771422:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612610.777380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612610.777464:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412416 00000100:00100000:2.0:1788612610.777507:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412416 00002000:00100000:2.0:1788612610.777560:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9611c7ac9c00 x1875495914412416/t0(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:256/0 lens 504/0 e 0 to 0 dl 1788612621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612610.777570:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c7ac9c00 with x1875495914412416 ext(0->12) 00002000:00010000:2.0:1788612610.777576:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c7ac9c00 00000100:00100000:2.0:1788612610.777604:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1788612610.777629:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+12:2395:x1875495914412416:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788612610.778874:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:2395:x1875495914412416:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 1241us (1497us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788612610.778886:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00002000:00100000:2.0:1788612610.778894:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9611c7ac9c00 x1875495914412416/t4294967321(0) o4->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:256/0 lens 504/448 e 0 to 0 dl 1788612621 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612610.778903:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9611c7ac9c00 with x1875495914412416 ext(0->12) 00002000:00010000:2.0:1788612610.778907:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9611c7ac9c00 00000100:00100000:3.0:1788612610.779081:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875495932284672:192.168.203.30@tcp:105: 00010000:00010000:3.0:1788612610.779107:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612610.779146:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:2395:x1875495914412288:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 7951us (8937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.779154:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:0.0:1788612610.781462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.781585:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412544 00000100:00100000:3.0:1788612610.781594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412544 00000100:00100000:3.0:1788612610.781691:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:3.0:1788612610.781701:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+73:12461:x1875495914412544:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788612610.783908:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788612610.783925:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788612610.783964:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788612610.783990:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9612fd6cae40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788612610.783996:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9611c67da500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9612fd6ca180 00000020:00080000:1.0:1788612610.783999:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9611c67dae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9611c756b600 00000004:00080000:1.0:1788612610.784028:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788612610.784051:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9611c6a54600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788612610.784054:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9611c7703700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9611c6a54a80 00000020:00080000:1.0:1788612610.784056:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9611c7703b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9611c67b8800 00000020:00080000:1.0:1788612610.784078:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788612610.784149:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788612610.784334:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612610.784354:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932284800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788612610.784419:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612610.784456:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612610.784465:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932284928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788612610.784515:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612610.784557:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932284800 00000100:00100000:3.0:1788612610.784564:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932284800 00000100:00100000:3.0:1788612610.784615:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932284928 00000100:00100000:3.0:1788612610.784618:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932284928 00000100:00100000:3.0:1788612610.784639:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788612610.784648:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1875495932284800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788612610.784675:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788612610.784702:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.784726:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 12 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.784744:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788612610.784748:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612610.784753:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.784785:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 12 pid: 8543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.784799:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 12 pid: 8543 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.784811:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875495932285056:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612610.784871:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecf00 going to sleep for 11 seconds 00000100:00080000:3.0:1788612610.784884:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612610.784962:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12461:x1875495914412544:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 3263us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.784972:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:1.0:1788612610.785279:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612610.785306:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875495932284928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788612610.785416:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788612610.785420:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788612610 00002000:00010000:1.0:1788612610.785422:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788612610.785424:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788612610 -> 1788612610 00002000:00010000:1.0:1788612610.785427:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788612610.785503:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3651:x1875495932284928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (986us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788612610.785510:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1788612610.785930:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.785942:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.785949:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.785955:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799aa00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.785959:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.785966:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.785982:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9612c4d8b400) 00010000:00010000:2.0:1788612610.785985:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.785989:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786011:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc8ce7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786039:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786046:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786052:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786057:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.786060:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786066:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786075:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9611c76e6100) 00010000:00010000:2.0:1788612610.786078:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.786081:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786086:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240600/0x1f8616bf0bc8d8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786119:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786126:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786138:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786143:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.786147:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786153:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786162:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:2.0:1788612610.786164:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.786167:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786173:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a000/0x1f8616bf0bc8e0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786187:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786193:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786199:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786204:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.786207:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786223:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786233:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9612c4d8bc00) 00010000:00010000:2.0:1788612610.786235:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.786238:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786244:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc8e30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786261:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786268:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786273:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786279:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.786281:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786287:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786307:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:2.0:1788612610.786310:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612610.786323:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786339:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240c00/0x1f8616bf0bc8f02 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786353:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786359:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786364:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786369:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.786372:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786378:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786387:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:2.0:1788612610.786389:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788612610.786396:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.786402:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bc8fbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.786754:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612610.786770:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932285184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788612610.786823:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612610.786865:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932285184 00000100:00100000:1.0:1788612610.786872:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932285184 00000100:00100000:1.0:1788612610.786919:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612610.786928:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3650:x1875495932285184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788612610.786949:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1788612610.786974:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c1001, atime: 0x6a9c1001, ctime: 0x6a9c1001, blocks: 0x8 00010000:00010000:1.0:1788612610.786981:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.786994:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788612610.786998:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612610.787004:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.787031:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.787040:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.787047:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.787064:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788612610.787183:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3650:x1875495932285184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 256us (359us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788612610.787192:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1788612610.787233:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c7ac8000/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788612610.787240:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932285184:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788612610.787519:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c81fce00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788612610.787526:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932284928:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788612610.788908:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612610.788921:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.788934:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612610.788939:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.788951:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.788971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.788980:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009677b68f/0x1f8616bf0bc8ff0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.789004:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612610.789006:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612610.789008:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612610.793413:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.793465:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.793533:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412800 00000100:00100000:2.0:1788612610.793548:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412672 00000100:00100000:2.0:1788612610.793551:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412672 00000100:00100000:1.0:1788612610.793551:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412800 00010000:00010000:1.0:1788612610.793591:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 14 pid: 8543 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.793608:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:2.0:1788612610.793618:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:2394:x1875495914412672:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788612610.793620:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:1.0:1788612610.793626:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+14:2394:x1875495914412800:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612610.793642:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612610.793647:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 14 pid: 8543 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.793666:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 14 pid: 8543 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.793690:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612610.793694:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612610.793700:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.793710:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.793731:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612610.794081:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05f6600/0x1f8616bf0bc8d9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2242f expref: 14 pid: 8543 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.794098:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875495932285056:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612610.794206:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.794219:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.794227:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.794237:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.794246:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.794308:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788612610.794328:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+13:2394:x1875495914412800:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 701us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.794335:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:3.0:1788612610.794515:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875495932284800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9867us (10095us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788612610.794523:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1788612610.795354:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612610.795364:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.795429:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612610.795434:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.795446:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.795464:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.795471:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a13f8336/0x1f8616bf0bc8fe9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.795521:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612610.795523:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612610.795525:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788612610.795612:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c81ff100/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788612610.795618:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932284800:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788612610.796687:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788612610.796701:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788612610.796895:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914412672:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 3275us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.796905:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1788612610.800114:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.800198:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413056 00000100:00100000:1.0:1788612610.800207:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413056 00000100:00100000:1.0:1788612610.800268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:1.0:1788612610.800279:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12461:x1875495914413056:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612610.800369:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612610.800395:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc8fd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c9 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.800414:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:1.0:1788612610.800419:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612610.800448:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.800461:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.800471:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612610.800633:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0d9cc0c reply state 00000000449c57a7 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.800645:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.800651:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:1.0:1788612610.800654:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612610.800657:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612610.800752:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:12461:x1875495914413056:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 475us (646us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788612610.800760:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:0.0:1788612610.803443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.804683:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413184 00000100:00100000:1.0:1788612610.804697:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413184 00000100:00100000:1.0:1788612610.805035:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:1.0:1788612610.805060:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914413184:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788612610.805226:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788612610.805231:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788612610 -> 1788612610 00002000:00010000:1.0:1788612610.805234:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788612609 00002000:00010000:1.0:1788612610.805236:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788612610 -> 1788612610 00002000:00010000:1.0:1788612610.805238:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788612610.805325:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914413184:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 259us (1882us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788612610.805333:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:3.0:1788612610.807779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612610.808124:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413440 00000100:00100000:2.0:1788612610.808143:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413440 00000100:00100000:2.0:1788612610.808203:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:2.0:1788612610.808213:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:12461:x1875495914413440:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788612610.808273:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.808287:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.808297:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.808340:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 22 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.808353:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 22 pid: 12327 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.808366:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932285312:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612610.808440:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612610.810950:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.811107:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413568 00000100:00100000:0.0:1788612610.811118:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413568 00010000:00010000:0.0:1788612610.811178:0:10342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 23 pid: 12327 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.811219:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:0.0:1788612610.811230:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:2394:x1875495914413568:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612610.811244:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612610.811251:0:10342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 23 pid: 12327 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.811264:0:10342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 23 pid: 12327 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.811285:0:10342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:0.0:1788612610.811290:0:10342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.811301:0:10342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.811308:0:10342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.811338:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612610.811392:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+23:2394:x1875495914413568:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 164us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.811400:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00010000:00010000:2.0:1788612610.811848:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc8fb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224bb expref: 22 pid: 12327 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.811870:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932285312:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612610.811889:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811909:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811915:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811950:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811957:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811963:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811968:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612610.811972:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811979:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.811989:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:2.0:1788612610.811991:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788612610.811995:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.812001:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc8ffe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.812100:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12461:x1875495914413440:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 3887us (4328us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788612610.812114:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:3.0:1788612610.818564:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.818661:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413696 00000100:00100000:0.0:1788612610.818671:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413696 00000100:00100000:0.0:1788612610.818736:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:0.0:1788612610.818890:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2395:x1875495914413696:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788612610.818936:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.818958:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.818968:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612610.818972:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612610.818978:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.819016:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.819031:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 8 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.819045:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875495932285440:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612610.819134:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612610.824234:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.824347:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875495932285440:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612610.824389:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.825240:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413824 00000100:00100000:2.0:1788612610.825249:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413824 00010000:00010000:2.0:1788612610.825287:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.825338:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:2.0:1788612610.825349:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914413824:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612610.825676:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612610.825698:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.825905:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.825934:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abad682d/0x1f8616bf0bc8fe2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224d7 expref: 9 pid: 8439 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.825951:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612610.825956:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612610.825962:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.825972:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.826067:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612610.826141:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2394:x1875495914413824:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 792us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612610.826149:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00010000:00010000:3.0:1788612610.827653:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827671:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827699:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827903:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827913:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827920:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612610.827925:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827933:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827951:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.827978:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f717e7/0x1f8616bf0bc9005 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.828132:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914413696:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 9234us (9566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612610.828143:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:1.0:1788612610.831187:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.831249:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414080 00000100:00100000:3.0:1788612610.831258:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414080 00000100:00100000:3.0:1788612610.831332:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:3.0:1788612610.831343:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:12461:x1875495914414080:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788612610.831431:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.831451:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.831460:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.831517:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.831533:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 21 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.831547:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932285568:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612610.832174:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612610.837087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.837383:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932285568:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612610.837416:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.837697:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414208 00000100:00100000:0.0:1788612610.837873:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414208 00010000:00010000:0.0:1788612610.837911:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.837976:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:0.0:1788612610.837998:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:2395:x1875495914414208:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612610.838011:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612610.838018:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838030:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838050:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc8efb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22483 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838065:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612610.838070:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838080:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838087:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838095:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.838130:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612610.838184:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:2395:x1875495914414208:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 187us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.838191:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00010000:00010000:1.0:1788612610.839030:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.839041:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.839224:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.839239:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.839247:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.839277:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612610.839307:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 21 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.839332:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932285696:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612610.839412:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54240 going to sleep for 11 seconds 00000100:00100000:1.0:1788612610.843508:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.843670:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932285696:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612610.843697:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.843991:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414336 00000100:00100000:0.0:1788612610.844014:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414336 00010000:00010000:0.0:1788612610.844052:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612610.844093:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:0.0:1788612610.844103:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:2394:x1875495914414336:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612610.844118:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612610.844135:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.844147:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.844170:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ae00/0x1f8616bf0bc8fc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224c2 expref: 22 pid: 6523 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.844186:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:0.0:1788612610.844191:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.844200:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.844208:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.844239:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612610.844291:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:2394:x1875495914414336:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 189us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.844308:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 109 00010000:00010000:3.0:1788612610.844519:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.844528:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612610.844636:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788612610.845149:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788612610.845191:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788612610.845268:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932285824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788612610.845340:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612610.845386:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612610.846609:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932285824 00000100:00100000:0.0:1788612610.846621:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932285824 00000100:00100000:0.0:1788612610.846670:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788612610.846679:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875495932285824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788612610.846930:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875495932285824:12345-0@lo:1000:mdt00_001.0 Request processed in 251us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.846938:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788612610.846985:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788612610.846990:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1788612610.847010:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c81fce00, transno 4294967322 00000004:00080000:0.0:1788612610.847018:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c81ff100, transno 4294967323 00000100:00100000:0.0:1788612610.847025:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932285824:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788612610.847153:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788612610.847214:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932285952:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788612610.847247:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612610.847269:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612610.847282:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932285952 00000100:00100000:0.0:1788612610.847285:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932285952 00000100:00100000:0.0:1788612610.847307:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788612610.847324:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875495932285952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788612610.848048:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1875495932285952:12345-0@lo:1000:mdt00_001.0 Request processed in 732us (798us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788612610.848057:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788612610.848142:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875495932285952:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788612610.848184:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848194:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848201:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848220:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799be00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.848224:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848232:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848247:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:3.0:1788612610.848249:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612610.848254:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848260:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799be00/0x1f8616bf0bc9013 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848284:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848290:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848295:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848299:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.848302:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848307:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848337:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.848340:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612610.848347:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848560:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848570:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.848601:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.848613:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932286080:192.168.203.30@tcp:105: 00000100:00100000:3.0:1788612610.848682:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c29c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612610.853227:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.853373:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875495932286080:192.168.203.30@tcp:105: 00010000:00010000:3.0:1788612610.853406:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853418:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b000/0x1f8616bf0bc8f56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853451:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853466:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853540:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853551:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853557:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853564:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853570:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.853574:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853580:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853592:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.853595:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612610.853598:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853604:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc901a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853614:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853619:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853633:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853638:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612610.853640:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853646:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853654:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:3.0:1788612610.853656:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612610.853659:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.853665:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc900c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.853912:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:12461:x1875495914414080:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 22570us (22732us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788612610.853923:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000020:00080000:3.0:1788612610.853929:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788612610.854561:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612610.854567:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612610.855239:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788612610.855250:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612610.857527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.858239:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414464 00000100:00100000:0.0:1788612610.858250:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414464 00000100:00100000:0.0:1788612610.858300:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414720 00000100:00100000:0.0:1788612610.858304:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414720 00000100:00100000:0.0:1788612610.858332:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1788612610.858340:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:12460:x1875495914414464:12345-192.168.203.30@tcp:49:lfs.0 00000100:00100000:0.0:1788612610.858497:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+25:12460:x1875495914414464:12345-192.168.203.30@tcp:49:lfs.0 Request processed in 134us (5255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.858505:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1788612610.858525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:0.0:1788612610.858532:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c92bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+24:12461:x1875495914414720:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788612610.859908:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788612610.859951:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1788612610.859996:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.860014:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.860026:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.860034:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.860040:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.860047:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.860064:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788612610.860216:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c92bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12461:x1875495914414720:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 1680us (2696us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788612610.860225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000020:00080000:0.0:1788612610.860231:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788612610.860348:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612610.860366:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.860373:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612610.860378:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.860386:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.860400:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:2.0:1788612610.860403:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788612610.860408:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.860414:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897800/0x1f8616bf0bc9021 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.860428:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612610.860430:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612610.860431:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612610.863057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612610.864670:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414976 00000100:00100000:1.0:1788612610.864683:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414976 00000100:00100000:1.0:1788612610.864957:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:1.0:1788612610.864968:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12460:x1875495914414976:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:1.0:1788612610.865215:0:8253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788612610.865338:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12460:x1875495914414976:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 371us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612610.865347:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:2.0:1788612610.902695:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612610.903024:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914415104 00000100:00100000:3.0:1788612610.903035:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914415104 00000100:00100000:3.0:1788612610.903095:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:3.0:1788612610.903106:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+26:12463:x1875495914415104:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612610.903139:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612610.903161:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc9028 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224de expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903235:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903251:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903264:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903278:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903285:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903292:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903381:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903392:0:12327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903401:0:12327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903434:0:12327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612610.903459:0:12327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 27 pid: 6525 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612610.903472:0:12327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932286208:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612610.903604:0:12327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c29c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612610.907634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612610.907734:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914415360 00000100:00100000:0.0:1788612610.907758:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914415360 00000100:00100000:0.0:1788612610.907815:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1788612610.907825:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:6163:x1875495914415360:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788612610.908032:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:6163:x1875495914415360:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 207us (405us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788612610.908039:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1788612610.908377:0:12327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12327:1875495932286208:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612610.908403:0:12327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612610.910701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612610.910866:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914415488 00000100:00100000:2.0:1788612610.910876:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914415488 00010000:00010000:2.0:1788612610.910918:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 29 pid: 6525 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612610.910964:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:2.0:1788612610.910975:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:2394:x1875495914415488:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612610.910990:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612610.910997:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 29 pid: 6525 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.911011:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 29 pid: 6525 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.911034:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b200/0x1f8616bf0bc8f48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2249f expref: 29 pid: 6525 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.911050:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:2.0:1788612610.911056:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.911066:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.911073:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612610.911113:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612610.911177:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+28:2394:x1875495914415488:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 204us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612610.911185:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00010000:00010000:0.0:1788612610.911392:0:12327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911401:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612610.911455:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788612610.911460:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612610.911521:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911536:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911545:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911550:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911567:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911572:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612610.911576:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911584:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911594:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:0.0:1788612610.911596:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612610.911600:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911606:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bc902f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911620:0:12327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911626:0:12327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911631:0:12327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911636:0:12327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612610.911639:0:12327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911655:0:12327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911664:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9611c76e6800) 00010000:00010000:0.0:1788612610.911666:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612610.911671:0:12327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911676:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911717:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bc9028 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224de expref: 28 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911731:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224de expref: 27 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612610.911875:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612610.911878:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612610.911880:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:0.0:1788612610.911931:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12463:x1875495914415104:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 8827us (9246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612610.911939:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:0.0:1788612611.055808:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612611.055834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932286336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612611.055905:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612611.056001:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932286336 00000100:00100000:2.0:1788612611.056010:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932286336 00000100:00100000:2.0:1788612611.056069:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788612611.056081:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932286336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612611.056118:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788612611.056173:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932286336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612611.056181:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788612611.056230:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932286336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788612611.439747:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612611.590718:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612611.590727:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612611.590757:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788612611.590762:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612611.673215:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673253:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673287:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673326:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673344:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673398:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.673423:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914415744 00000100:00100000:1.0:1788612611.673432:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914415744 00000100:00100000:1.0:1788612611.673503:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914416256 00000100:00100000:1.0:1788612611.673507:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914416256 00000100:00100000:1.0:1788612611.673529:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914415872 00000100:00100000:1.0:1788612611.673532:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914415872 00000100:00100000:1.0:1788612611.673544:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914416384 00000100:00100000:1.0:1788612611.673546:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914416384 00000100:00100000:1.0:1788612611.673563:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 331 00000100:00100000:1.0:1788612611.673571:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:2394:x1875495914415744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612611.673648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:2394:x1875495914415744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612611.673655:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 331 00000100:00100000:1.0:1788612611.673675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 332 00000100:00100000:1.0:1788612611.673681:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914416256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612611.673706:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914416256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612611.673712:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 332 00000100:00100000:1.0:1788612611.673723:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:1.0:1788612611.673730:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914415872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612611.673754:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914415872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612611.673760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:1.0:1788612611.673772:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 334 00000100:00100000:1.0:1788612611.673779:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914416384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612611.673810:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914416384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612611.673832:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 334 00000100:00100000:1.0:1788612611.673859:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914416000 00000100:00100000:1.0:1788612611.673863:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914416000 00000100:00100000:1.0:1788612611.673886:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914416128 00000100:00100000:1.0:1788612611.673889:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914416128 00000100:00100000:1.0:1788612611.673908:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1788612611.673914:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914416000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612611.673941:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914416000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612611.673948:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1788612611.673959:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:1.0:1788612611.673965:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914416128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612611.673987:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+9:2394:x1875495914416128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612611.673993:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1788612611.674151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914415616 00000100:00100000:3.0:1788612611.674157:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914415616 00000100:00100000:3.0:1788612611.674191:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 390 00000100:00100000:3.0:1788612611.674201:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914415616:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612611.674233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914415616:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612611.674239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 390 00000100:00080000:3.0:1788612611.674270:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612611.674274:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612611.674276:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788612611.888878:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612611.888885:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612611.888910:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788612611.888917:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612611.889052:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932286464:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612611.889224:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612611.895604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612611.895888:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875495932286464:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612611.897592:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914416512 00000100:00100000:2.0:1788612611.897607:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914416512 00000100:00100000:2.0:1788612611.897747:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:2.0:1788612611.897759:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12476:x1875495914416512:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788612611.897792:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788612611.897922:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12476:x1875495914416512:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 165us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612611.897936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:2.0:1788612611.903837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612611.907602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914416768 00000100:00100000:1.0:1788612611.907647:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914416768 00000100:00100000:1.0:1788612611.907739:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:1.0:1788612611.907751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+27:12476:x1875495914416768:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612611.907776:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612611.907802:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9044 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224e5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612611.907931:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc904b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612611.907948:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc904b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612611.907964:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc904b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612611.907976:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788612611.908113:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9044 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224e5 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612611.908137:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc904b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224e5 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612611.908147:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612611.908151:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612611.908155:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799aa00, rc 0) 00000100:00100000:1.0:1788612611.909545:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:12476:x1875495914416768:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1785us (5712us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788612611.909560:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:3.0:1788612611.919929:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612611.920071:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914417024 00000100:00100000:0.0:1788612611.920091:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914417024 00000100:00100000:0.0:1788612611.920167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:0.0:1788612611.920181:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+29:12476:x1875495914417024:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788612611.920315:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920340:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920356:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920592:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920602:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920610:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920617:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612611.920623:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920632:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920647:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612611.920651:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612611.920656:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612611.920675:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bc9059 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612611.920821:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:12476:x1875495914417024:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 643us (906us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788612611.920829:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 252 00000040:00080000:3.0:1788612611.921135:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612611.921141:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612611.921727:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788612611.921738:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788612611.926851:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612611.926958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612611.927044:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914417152 00000100:00100000:0.0:1788612611.927055:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914417152 00000100:00100000:0.0:1788612611.927134:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1788612611.927146:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:2395:x1875495914417152:12345-192.168.203.30@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788612611.927158:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914417408 00000100:00100000:3.0:1788612611.927162:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914417408 00010000:00010000:0.0:1788612611.927166:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612611.927198:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799aa00/0x1f8616bf0bc904b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224e5 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612611.927205:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612611.927213:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:12476:x1875495914417408:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1788612611.927220:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:0.0:1788612611.927226:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612611.927304:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:2395:x1875495914417152:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 146us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612611.927319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1788612611.927472:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:12476:x1875495914417408:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 260us (514us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788612611.927514:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00010000:00010000:2.0:1788612612.464931:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612612.593427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932286720:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.593547:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.593610:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932287232:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.593647:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.593669:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932287744:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.593697:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.593746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932288256:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.593877:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.593909:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788612612.593915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932287104:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.593943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.593963:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.593984:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932288128:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594054:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932286848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594080:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594242:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932287360:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594274:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932287872:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594336:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594356:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612612.594361:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932286976:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594383:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594420:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932287488:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594466:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932288000:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.594510:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.594544:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287232 00000100:00100000:1.0:1788612612.594553:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287232 00000100:00100000:1.0:1788612612.594602:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932286976 00000100:00100000:1.0:1788612612.594606:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932286976 00000100:00100000:1.0:1788612612.594629:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788612612.594640:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c485ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932287232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.594662:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287744 00000100:00100000:3.0:1788612612.594668:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287744 00000100:00100000:3.0:1788612612.594711:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288256 00000100:00100000:1.0:1788612612.594715:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c485ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932287232:12345-0@lo:400:kworker.0 Request processed in 75us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612612.594716:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288256 00000100:00100000:1.0:1788612612.594728:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788612612.594737:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287616 00000100:00100000:3.0:1788612612.594741:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287616 00000100:00100000:3.0:1788612612.594755:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288128 00000100:00100000:3.0:1788612612.594757:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288128 00000100:00100000:3.0:1788612612.594771:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788612612.594778:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fee32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932287744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.594826:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fee32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932287744:12345-0@lo:400:kworker.0 Request processed in 48us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612612.594834:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788612612.595117:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612612.595125:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1875495932288256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.595166:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1875495932288256:12345-0@lo:400:kworker.0 Request processed in 41us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612612.595189:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788612612.595214:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788612612.595223:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932287616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.595262:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932287616:12345-0@lo:400:kworker.0 Request processed in 42us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612612.595270:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788612612.595286:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788612612.595295:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932288128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.595336:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788612612.595341:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932288128:12345-0@lo:400:kworker.0 Request processed in 47us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612612.595348:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932286976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.595353:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788612612.595386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612612.595392:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932286976:12345-0@lo:400:kworker.0 Request processed in 46us (1006us total) trans 0 rc 0/0 00000100:00080000:3.0:1788612612.595393:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612612.595401:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788612612.595415:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287104 00000100:00100000:3.0:1788612612.595420:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287104 00000100:00100000:1.0:1788612612.595426:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932286848 00000100:00100000:1.0:1788612612.595432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932286848 00000100:00100000:3.0:1788612612.595449:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287360 00000100:00100000:3.0:1788612612.595454:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287360 00000100:00100000:1.0:1788612612.595458:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287872 00000100:00100000:1.0:1788612612.595463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287872 00000100:00100000:1.0:1788612612.595506:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932287488 00000100:00100000:1.0:1788612612.595510:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932287488 00000100:00100000:3.0:1788612612.595511:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288000 00000100:00100000:3.0:1788612612.595516:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288000 00000100:00100000:1.0:1788612612.595536:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788612612.595545:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932287104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.595552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788612612.595562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932286848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.595584:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932287104:12345-0@lo:400:kworker.0 Request processed in 40us (1639us total) trans 0 rc 0/0 00000100:00080000:2.0:1788612612.595598:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612612.595602:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1788612612.595603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612612.595609:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932286848:12345-0@lo:400:kworker.0 Request processed in 48us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612612.595617:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788612612.596053:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788612612.596063:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932287872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.596158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932287872:12345-0@lo:400:kworker.0 Request processed in 98us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612612.596165:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788612612.596240:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788612612.596247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932287360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.596279:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932287360:12345-0@lo:400:kworker.0 Request processed in 33us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612612.596285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788612612.596351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788612612.596358:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932287488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.596389:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932287488:12345-0@lo:400:kworker.0 Request processed in 32us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612612.596395:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788612612.596407:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788612612.596413:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932288000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.596441:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932288000:12345-0@lo:400:kworker.0 Request processed in 28us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612612.596447:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788612612.596467:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612612.596503:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932286592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612612.596544:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.596612:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932286720 00000100:00100000:1.0:1788612612.596619:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932286720 00000100:00100000:1.0:1788612612.596658:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788612612.596667:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932286720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.596705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932286720:12345-0@lo:400:kworker.0 Request processed in 41us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612612.596711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788612612.596729:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932288384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612612.596831:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932286592 00000100:00100000:3.0:1788612612.596836:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932286592 00000100:00100000:3.0:1788612612.596865:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788612612.596880:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3651:x1875495932286592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612612.596907:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612612.596958:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612612.596987:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288384 00000100:00100000:1.0:1788612612.596993:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288384 00000100:00100000:1.0:1788612612.597033:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788612612.597042:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932288384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612612.597052:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932286976:0@lo:400:kworker.0 00002000:00000024:1.0:1788612612.597054:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788612612.597079:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79aa300 x1875495932287488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612612.597092:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932287488:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597110:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932288384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (141us total) trans 0 rc 0/0 00010000:00080000:0.0:1788612612.597119:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c815dc00 x1875495932288000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612612.597122:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788612612.597134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932288000:0@lo:400:kworker.0 00000100:00100000:0.0:1788612612.597154:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932286848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597166:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932288384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612612.597173:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788612612.597188:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932287872:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597236:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932287104:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597258:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932287616:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597269:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932288128:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597278:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932286720:0@lo:400:kworker.0 00000100:00100000:3.0:1788612612.597400:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3651:x1875495932286592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 376us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612612.597409:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788612612.597458:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932286592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612612.597605:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932287232:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597626:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932287744:0@lo:400:kworker.0 00000100:00100000:1.0:1788612612.597638:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932288256:0@lo:400:kworker.0 00000001:00080000:2.0:1788612612.600702:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788612612.600733:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788612613.103679:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932288512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612613.103746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612613.103824:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288512 00000100:00100000:1.0:1788612613.103832:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288512 00000100:00100000:2.0:1788612613.103850:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932288640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612613.103889:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612613.103900:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788612613.103912:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932288512:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612613.103926:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288640 00000100:00100000:2.0:1788612613.103931:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288640 00002000:00000024:1.0:1788612613.103951:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788612613.103965:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788612613.103973:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932288640:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612613.103997:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932288512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (250us total) trans 0 rc 0/0 00000004:00000024:2.0:1788612613.103998:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612613.104009:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788612613.104044:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932288640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612613.104051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788612613.104097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932288640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612613.104143:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932288512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612613.108094:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612613.108117:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932288768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612613.108190:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612613.108249:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288768 00000100:00100000:1.0:1788612613.108255:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288768 00000100:00100000:1.0:1788612613.108315:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788612613.108324:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932288768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612613.108344:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788612613.108391:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932288768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612613.108398:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788612613.108443:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932288768:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788612613.450989:0:14814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612613.450999:0:14814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612613.451038:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788612613.451045:0:14814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788612613.494163:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612613.600387:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612613.600426:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914417664 00000100:00100000:2.0:1788612613.600435:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914417664 00000100:00100000:2.0:1788612613.600511:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:2.0:1788612613.600522:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+30:12496:x1875495914417664:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612613.600546:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612613.600567:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9060 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224ec expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.600686:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc9067 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.600701:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc9067 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.600722:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc9067 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612613.600735:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788612613.600836:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9060 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224ec expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.600852:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc9067 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224ec expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.600862:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:2.0:1788612613.600864:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788612613.600868:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37e00, rc 0) 00000100:00100000:2.0:1788612613.601068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12496:x1875495914417664:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 548us (690us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788612613.601076:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00080000:2.0:1788612613.601100:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612613.613812:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612613.614945:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914417792 00000100:00100000:2.0:1788612613.614960:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914417792 00000100:00100000:2.0:1788612613.615043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:2.0:1788612613.615057:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12496:x1875495914417792:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:2.0:1788612613.615129:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615147:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615161:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615209:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615217:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615223:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615229:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612613.615233:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615241:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615256:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:2.0:1788612613.615260:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612613.615266:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612613.615273:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc9075 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612613.615366:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+32:12496:x1875495914417792:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 313us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612613.615376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:0.0:1788612613.721633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612613.721774:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914417920 00000100:00100000:3.0:1788612613.721784:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914417920 00000100:00100000:3.0:1788612613.721869:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:3.0:1788612613.721882:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2396:x1875495914417920:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1788612613.721904:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612613.721926:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f998cfca/0x1f8616bf0bc907c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224f3 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612613.721951:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c1002, atime: 0x6a9c1001, ctime: 0x6a9c1002, blocks: 0x8 00010000:00010000:3.0:1788612613.721971:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1788612613.721975:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612613.721986:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f998cfca/0x1f8616bf0bc907c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224f3 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612613.722006:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f998cfca/0x1f8616bf0bc907c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224f3 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612613.722019:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241400, rc 0) 00000100:00100000:3.0:1788612613.722082:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2396:x1875495914417920:12345-192.168.203.30@tcp:101:cat.0 Request processed in 202us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612613.722100:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00080000:2.0:1788612613.722181:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612613.728945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612613.729407:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418048 00000100:00100000:3.0:1788612613.729418:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418048 00002000:00100000:3.0:1788612613.729499:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9612fed70a80 x1875495914418048/t0(0) o3->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:259/0 lens 488/0 e 0 to 0 dl 1788612624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612613.729511:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9612fed70a80 with x1875495914418048 ext(0->4095) 00002000:00010000:3.0:1788612613.729517:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9612fed70a80 00000100:00100000:3.0:1788612613.729552:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788612613.729562:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2397:x1875495914418048:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:3.0:1788612613.732504:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+8:2397:x1875495914418048:12345-192.168.203.30@tcp:3:cat.0 Request processed in 2905us (3533us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788612613.732521:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00002000:00100000:3.0:1788612613.732535:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9612fed70a80 x1875495914418048/t0(0) o3->e1800c7e-b9d8-4080-b6d8-c71cdf3d497c@192.168.203.30@tcp:259/0 lens 488/4536 e 0 to 0 dl 1788612624 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612613.732546:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9612fed70a80 with x1875495914418048 ext(0->4095) 00002000:00010000:3.0:1788612613.732552:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9612fed70a80 00000040:00080000:3.0:1788612613.872361:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788612614.001905:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612614.001915:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612614.001947:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788612614.001956:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788612614.511673:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612615.535725:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612616.175749:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932288896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612616.175822:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612616.175949:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932288896 00000100:00100000:3.0:1788612616.175957:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932288896 00000100:00100000:3.0:1788612616.176039:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788612616.176049:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932288896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612616.176091:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788612616.176157:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932288896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612616.176165:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788612616.176229:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932288896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788612616.561867:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788612616.690167:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788612616.690184:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788612616.691153:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788612616.691184:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9612fd6ca300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788612616.691190:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9611c67da100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9612fd6ca480 00000020:00080000:1.0:1788612616.691193:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9611c67da900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9611c783de00 00000020:00080000:1.0:1788612616.691222:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788612616.691240:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612616.691252:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612616.691259:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612616.691264:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ba00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612616.691268:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612616.691286:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612616.691319:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9612c8ef5e00) 00010000:00010000:0.0:1788612616.691322:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612616.691328:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612616.691334:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ba00/0x1f8616bf0bc8ff7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788612616.694349:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788612616.694443:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788612616.792913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612616.792960:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612616.792994:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612616.793073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418176 00000100:00100000:3.0:1788612616.793082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418176 00000100:00100000:0.0:1788612616.793110:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612616.793112:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418432 00000100:00100000:2.0:1788612616.793119:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418432 00000100:00100000:0.0:1788612616.793144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612616.793153:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 392 00000100:00100000:3.0:1788612616.793166:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914418176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612616.793170:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418944 00000100:00100000:0.0:1788612616.793175:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612616.793177:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418944 00000100:00100000:2.0:1788612616.793207:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418304 00000100:00100000:2.0:1788612616.793211:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418304 00000100:00100000:2.0:1788612616.793231:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 341 00000100:00100000:3.0:1788612616.793241:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914418176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612616.793241:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914418432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612616.793256:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 392 00000100:00100000:2.0:1788612616.793295:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914418432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 56us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612616.793303:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 341 00000100:00100000:2.0:1788612616.793321:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:2.0:1788612616.793329:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914418944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612616.793334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:3.0:1788612616.793346:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2395:x1875495914418304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612616.793362:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914418944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612616.793369:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:3.0:1788612616.793384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2395:x1875495914418304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612616.793394:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00080000:3.0:1788612616.793418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612616.793423:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612616.796012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612616.796093:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418816 00000100:00100000:2.0:1788612616.796111:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418816 00000100:00100000:2.0:1788612616.796178:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:2.0:1788612616.796187:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914418816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612616.796257:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914418816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612616.796264:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00080000:0.0:1788612616.796696:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612616.796830:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418688 00000100:00100000:1.0:1788612616.796836:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418688 00000100:00100000:1.0:1788612616.796887:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914418560 00000100:00100000:1.0:1788612616.796891:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914418560 00000100:00100000:1.0:1788612616.796916:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1788612616.796925:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914418688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612616.796966:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914418688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612616.796972:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1788612616.796987:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1788612616.796993:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914418560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612616.797018:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914418560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612616.797024:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00080000:0.0:1788612616.797147:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612616.797150:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788612617.585134:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612617.712861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.712932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.712976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932289536:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713002:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713031:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932290048:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713073:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932290560:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713094:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713116:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788612617.713122:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713162:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713197:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932290176:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713247:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932289280:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713282:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713300:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932289792:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713335:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932290304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713356:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713373:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788612617.713378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713398:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932289920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713427:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612617.713538:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289024 00000100:00100000:1.0:1788612617.713547:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289024 00000100:00100000:1.0:1788612617.713597:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788612617.713607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932289024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3648:x1875495932289024:12345-0@lo:400:kworker.0 Request processed in 54us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.713667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788612617.713697:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289536 00000100:00100000:1.0:1788612617.713700:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289536 00000100:00100000:1.0:1788612617.713717:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289280 00000100:00100000:1.0:1788612617.713719:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289280 00000100:00100000:1.0:1788612617.713731:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788612617.713737:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932289536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713768:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932289536:12345-0@lo:400:kworker.0 Request processed in 31us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.713774:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788612617.713785:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788612617.713791:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932289280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713820:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932289280:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.713826:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788612617.713841:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290048 00000100:00100000:1.0:1788612617.713844:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290048 00000100:00100000:1.0:1788612617.713872:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290560 00000100:00100000:1.0:1788612617.713875:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290560 00000100:00100000:1.0:1788612617.713885:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289920 00000100:00100000:1.0:1788612617.713888:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289920 00000100:00100000:1.0:1788612617.713899:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290432 00000100:00100000:1.0:1788612617.713901:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290432 00000100:00100000:1.0:1788612617.713924:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788612617.713929:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.713960:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932290048:12345-0@lo:400:kworker.0 Request processed in 31us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.713965:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788612617.713977:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788612617.713982:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714006:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932290560:12345-0@lo:400:kworker.0 Request processed in 24us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714012:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788612617.714023:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788612617.714028:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714052:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932289920:12345-0@lo:400:kworker.0 Request processed in 24us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714058:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788612617.714069:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788612617.714074:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932290432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714101:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932290432:12345-0@lo:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714106:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788612617.714125:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289152 00000100:00100000:1.0:1788612617.714129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289152 00000100:00100000:1.0:1788612617.714147:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289664 00000100:00100000:1.0:1788612617.714150:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289664 00000100:00100000:1.0:1788612617.714161:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290176 00000100:00100000:1.0:1788612617.714163:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290176 00000100:00100000:1.0:1788612617.714173:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289792 00000100:00100000:1.0:1788612617.714181:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289792 00000100:00100000:1.0:1788612617.714196:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290304 00000100:00100000:1.0:1788612617.714198:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290304 00000100:00100000:1.0:1788612617.714208:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932289408 00000100:00100000:1.0:1788612617.714211:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932289408 00000100:00100000:1.0:1788612617.714222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788612617.714227:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932289152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714256:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932289152:12345-0@lo:400:kworker.0 Request processed in 29us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788612617.714291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788612617.714297:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932289664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714323:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932289664:12345-0@lo:400:kworker.0 Request processed in 27us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714328:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788612617.714339:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788612617.714345:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714370:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932290176:12345-0@lo:400:kworker.0 Request processed in 26us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714376:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788612617.714387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788612617.714393:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932289792:12345-0@lo:400:kworker.0 Request processed in 26us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714424:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788612617.714434:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788612617.714440:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932290304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714470:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932290304:12345-0@lo:400:kworker.0 Request processed in 30us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714499:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788612617.714511:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788612617.714518:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932289408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714545:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932289408:12345-0@lo:400:kworker.0 Request processed in 28us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612617.714550:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:1.0:1788612617.714594:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612617.714598:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612617.714600:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612617.714603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612617.714647:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932289920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714670:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714681:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932289280:0@lo:400:kworker.0 00010000:00080000:1.0:1788612617.714694:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80efb80 x1875495932289792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612617.714705:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932289792:0@lo:400:kworker.0 00010000:00080000:1.0:1788612617.714715:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc6680 x1875495932290304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612617.714724:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932290304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714781:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714792:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932290176:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714801:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714811:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932289536:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714821:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788612617.714826:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788612617.714842:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932290048:0@lo:400:kworker.0 00000100:00100000:1.0:1788612617.714852:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788612617.714856:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1788612617.714876:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c7b4df80, transno 4294967308 00000004:00080000:1.0:1788612617.714891:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788612617.714900:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9611c7ac8000, transno 4294967311 00000100:00100000:1.0:1788612617.714905:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932290560:0@lo:400:kworker.0 00000100:00100000:0.0:1788612617.715254:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612617.715263:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932290688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612617.715316:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612617.715350:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290688 00000100:00100000:0.0:1788612617.715354:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290688 00000100:00100000:0.0:1788612617.715389:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612617.715396:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932290688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612617.715417:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612617.715453:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932290688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612617.715468:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612617.715526:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932290688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612617.722024:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612617.722049:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612617.722117:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612617.722162:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290816 00000100:00100000:2.0:1788612617.722169:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290816 00000100:00100000:2.0:1788612617.722219:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788612617.722229:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932290816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612617.722249:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612617.722301:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932290816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612617.722307:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788612617.722353:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612618.224673:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932290944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612618.224739:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612618.224801:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932291072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612618.224827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612618.224860:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932290944 00000100:00100000:2.0:1788612618.224867:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932290944 00000100:00100000:2.0:1788612618.224904:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788612618.224911:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932290944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612618.224937:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788612618.224974:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932290944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612618.224981:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788612618.225000:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291072 00000100:00100000:2.0:1788612618.225003:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291072 00000100:00100000:2.0:1788612618.225035:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788612618.225041:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932291072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612618.225061:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788612618.225093:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932291072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612618.225099:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788612618.225138:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932291072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612618.225165:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932290944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612618.231698:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932291200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612618.231767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612618.231917:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291200 00000100:00100000:3.0:1788612618.231925:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291200 00000100:00100000:3.0:1788612618.231971:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788612618.231979:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932291200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612618.231998:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788612618.232041:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932291200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612618.232058:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788612618.232100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932291200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612618.374903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612618.375001:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419072 00000100:00100000:1.0:1788612618.375011:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419072 00000100:00100000:1.0:1788612618.375221:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:1.0:1788612618.375234:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:12148:x1875495914419072:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788612618.375348:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:12148:x1875495914419072:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 118us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612618.375356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00080000:0.0:1788612618.375907:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612618.382606:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612618.383300:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419200 00000100:00100000:2.0:1788612618.383312:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419200 00000100:00100000:2.0:1788612618.383441:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:2.0:1788612618.383456:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:12148:x1875495914419200:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788612618.383601:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:12148:x1875495914419200:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 149us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612618.383610:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00080000:0.0:1788612618.387938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612618.388593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612618.388691:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419456 00000100:00100000:3.0:1788612618.388700:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419456 00000100:00100000:3.0:1788612618.388753:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1788612618.388763:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:12148:x1875495914419456:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612618.388975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:12148:x1875495914419456:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 212us (387us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788612618.388982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1788612618.602188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612618.602354:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419584 00000100:00100000:2.0:1788612618.602364:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419584 00000100:00100000:2.0:1788612618.602458:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:2.0:1788612618.602469:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:12953:x1875495914419584:12345-192.168.203.30@tcp:101:lsof.0 00010000:00010000:2.0:1788612618.602519:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612618.602542:0:12327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc9083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d224fa expref: -99 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612618.602605:0:12327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc908a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612618.602631:0:12327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc908a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612618.602645:0:12327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc908a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612618.602691:0:12327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612618.602695:0:12327:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612618.602718:0:12327:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc908a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612618.602743:0:12327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37200/0x1f8616bf0bc9083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224fa expref: 7 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612618.602761:0:12327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc908a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224fa expref: 6 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612618.602770:0:12327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:2.0:1788612618.602773:0:12327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612618.602777:0:12327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36600, rc 0) 00000100:00100000:2.0:1788612618.602843:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+6:12953:x1875495914419584:12345-192.168.203.30@tcp:101:lsof.0 Request processed in 375us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612618.602850:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00080000:0.0:1788612618.602998:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612618.607815:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612619.631795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612620.656877:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612621.295779:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932291328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612621.295846:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612621.296155:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291328 00000100:00100000:1.0:1788612621.296163:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291328 00000100:00100000:1.0:1788612621.296216:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788612621.296224:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932291328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612621.296262:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788612621.299171:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932291328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2939us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612621.299184:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788612621.302735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932291328:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788612621.679688:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612621.924927:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612621.924978:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612621.925015:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612621.925064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612621.925096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612621.925118:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612621.925143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612621.925152:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420224 00000100:00100000:0.0:1788612621.925163:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420224 00000100:00100000:1.0:1788612621.925170:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420096 00000100:00100000:1.0:1788612621.925176:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420096 00000100:00100000:0.0:1788612621.925230:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:0.0:1788612621.925255:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914420224:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612621.925270:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419968 00000100:00100000:2.0:1788612621.925290:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419968 00000100:00100000:0.0:1788612621.925328:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914420224:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612621.925330:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420480 00000100:00100000:2.0:1788612621.925335:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420480 00000100:00100000:0.0:1788612621.925339:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:2.0:1788612621.925353:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419840 00000100:00100000:2.0:1788612621.925355:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419840 00000100:00100000:2.0:1788612621.925366:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420352 00000100:00100000:2.0:1788612621.925368:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420352 00000100:00100000:2.0:1788612621.925386:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 351 00000100:00100000:2.0:1788612621.925395:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914419968:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612621.925396:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914419712 00000100:00100000:3.0:1788612621.925403:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914419712 00000100:00100000:2.0:1788612621.925434:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2394:x1875495914419968:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612621.925441:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 351 00000100:00100000:3.0:1788612621.925451:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 394 00000100:00100000:2.0:1788612621.925465:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 352 00000100:00100000:3.0:1788612621.925466:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914419712:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612621.925520:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914420480:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612621.925534:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2394:x1875495914419712:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 74us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612621.925542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 394 00000100:00100000:2.0:1788612621.925570:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+5:2394:x1875495914420480:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612621.925579:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 353 00000100:00100000:2.0:1788612621.925588:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 352 00000100:00100000:3.0:1788612621.925590:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:2394:x1875495914419840:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612621.925612:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 354 00000100:00100000:2.0:1788612621.925622:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+6:2394:x1875495914420352:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612621.925628:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:2394:x1875495914419840:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612621.925635:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 353 00000100:00100000:2.0:1788612621.925658:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:449720ee-67e1-48cb-85d0-ee79593410d8+6:2394:x1875495914420352:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612621.925666:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 354 00000100:00080000:2.0:1788612621.925763:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612621.925768:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612621.925772:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612621.925774:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612621.925965:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:1.0:1788612621.925974:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914420096:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612621.926010:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2394:x1875495914420096:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612621.926016:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000001:00080000:1.0:1788612622.322417:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788612622.322447:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788612622.323185:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788612622.323200:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:1.0:1788612622.654893:0:15011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:50:21 (1788612621) 00010000:00010000:1.0:1788612622.703598:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612622.834372:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932291456:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834443:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834506:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834532:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834552:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932292480:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834581:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834599:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834621:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834645:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788612622.834651:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932291840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834676:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834696:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834716:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834731:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932292864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834752:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834780:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932291712:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834819:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834841:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834857:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932292736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834876:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834892:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788612622.834898:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932291584:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834949:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.834970:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.834985:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835005:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.835028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291456 00000100:00100000:1.0:1788612622.835036:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291456 00000100:00100000:1.0:1788612622.835081:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788612622.835090:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932291456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3651:x1875495932291456:12345-0@lo:400:kworker.0 Request processed in 49us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788612622.835177:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291968 00000100:00100000:1.0:1788612622.835181:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291968 00000100:00100000:1.0:1788612622.835198:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291712 00000100:00100000:1.0:1788612622.835201:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291712 00000100:00100000:1.0:1788612622.835214:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788612622.835220:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835266:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932291968:12345-0@lo:400:kworker.0 Request processed in 45us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788612622.835286:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788612622.835291:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835323:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932291712:12345-0@lo:400:kworker.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835330:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788612622.835345:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292480 00000100:00100000:1.0:1788612622.835349:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292480 00000100:00100000:1.0:1788612622.835385:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292992 00000100:00100000:1.0:1788612622.835388:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292992 00000100:00100000:1.0:1788612622.835399:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292352 00000100:00100000:1.0:1788612622.835402:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292352 00000100:00100000:1.0:1788612622.835413:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292864 00000100:00100000:1.0:1788612622.835415:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292864 00000100:00100000:1.0:1788612622.835427:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788612622.835433:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932292480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835465:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932292480:12345-0@lo:400:kworker.0 Request processed in 31us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835470:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788612622.835502:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788612622.835508:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835535:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932292992:12345-0@lo:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835541:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788612622.835551:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788612622.835557:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835583:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932292352:12345-0@lo:400:kworker.0 Request processed in 26us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835588:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788612622.835598:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612622.835604:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932292864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835628:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932292864:12345-0@lo:400:kworker.0 Request processed in 25us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835633:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612622.835651:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291840 00000100:00100000:1.0:1788612622.835661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291840 00000100:00100000:1.0:1788612622.835681:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292224 00000100:00100000:1.0:1788612622.835684:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292224 00000100:00100000:1.0:1788612622.835696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292736 00000100:00100000:1.0:1788612622.835698:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292736 00000100:00100000:1.0:1788612622.835708:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932291584 00000100:00100000:1.0:1788612622.835711:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932291584 00000100:00100000:1.0:1788612622.835718:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292096 00000100:00100000:1.0:1788612622.835720:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292096 00000100:00100000:1.0:1788612622.835730:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932292608 00000100:00100000:1.0:1788612622.835732:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932292608 00000100:00100000:1.0:1788612622.835745:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788612622.835750:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932291840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835781:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932291840:12345-0@lo:400:kworker.0 Request processed in 30us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788612622.835798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788612622.835804:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932292224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932292224:12345-0@lo:400:kworker.0 Request processed in 26us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788612622.835845:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788612622.835850:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932292736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835876:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932292736:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835882:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788612622.835893:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788612622.835899:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932291584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835934:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932291584:12345-0@lo:400:kworker.0 Request processed in 35us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788612622.835950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788612622.835956:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.835981:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932292096:12345-0@lo:400:kworker.0 Request processed in 26us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.835987:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788612622.835997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788612622.836003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932292608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836028:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932292608:12345-0@lo:400:kworker.0 Request processed in 25us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.836034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788612622.836103:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932291584:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836115:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836133:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932291712:0@lo:400:kworker.0 00010000:00080000:1.0:1788612622.836144:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4a80 x1875495932292224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612622.836154:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932292224:0@lo:400:kworker.0 00010000:00080000:1.0:1788612622.836162:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80ed880 x1875495932292736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612622.836182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932292736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836227:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932291840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836252:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836261:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932292864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836270:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932291456:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836280:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836290:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932292480:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.836300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788612622.839514:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612622.839536:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932293120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612622.839600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612622.847537:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612622.847554:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612622.847558:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612622.847561:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612622.847580:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293120 00000100:00100000:2.0:1788612622.847591:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293120 00000100:00100000:2.0:1788612622.847645:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788612622.847656:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932293120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612622.847690:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612622.847769:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932293120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (8168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612622.847776:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788612622.850374:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612622.850395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612622.850458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612622.850689:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293248 00000100:00100000:1.0:1788612622.850697:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293248 00000100:00100000:1.0:1788612622.850745:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788612622.850753:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932293248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612622.850776:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612622.850828:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932293248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612622.850834:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788612622.850883:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612622.851093:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932293120:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788612623.088141:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612623.343642:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612623.343665:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932293376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612623.343732:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612623.343792:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932293504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612623.343817:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612623.343847:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293376 00000100:00100000:2.0:1788612623.343854:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293376 00000100:00100000:2.0:1788612623.343901:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293504 00000100:00100000:2.0:1788612623.343905:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293504 00000100:00100000:2.0:1788612623.343923:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788612623.343933:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932293376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612623.343939:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788612623.343951:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932293504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612623.343965:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:3.0:1788612623.343967:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788612623.344023:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932293376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612623.344036:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788612623.344089:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932293504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612623.344113:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932293376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612623.344459:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612623.344469:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932293632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612623.344535:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612623.344566:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293632 00000100:00100000:0.0:1788612623.344571:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293632 00000100:00100000:0.0:1788612623.344604:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788612623.344611:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932293632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612623.344635:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788612623.344672:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932293632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612623.344678:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788612623.344721:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932293632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612623.350321:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932293504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6349us (6478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612623.350338:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:1.0:1788612623.731169:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612624.239685:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612624.239695:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612624.239802:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788612624.239810:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788612624.753094:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612625.775854:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612626.416841:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612626.416864:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932293760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612626.416931:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612626.418524:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293760 00000100:00100000:0.0:1788612626.418536:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293760 00000100:00100000:0.0:1788612626.418600:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788612626.418611:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932293760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612626.418649:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788612626.418736:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932293760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612626.418743:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788612626.418916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932293760:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788612626.799653:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612627.033316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033392:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033414:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033431:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033447:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.033536:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914421120 00000100:00100000:1.0:1788612627.033546:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914421120 00000100:00100000:1.0:1788612627.033596:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420992 00000100:00100000:1.0:1788612627.033599:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420992 00000100:00100000:1.0:1788612627.033622:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:1.0:1788612627.033645:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914421120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612627.033709:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914421120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.033716:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:1.0:1788612627.033733:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:1.0:1788612627.033751:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914420992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612627.033777:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2395:x1875495914420992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.033801:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1788612627.034384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420608 00000100:00100000:3.0:1788612627.034393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420608 00000100:00100000:3.0:1788612627.034433:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 396 00000100:00100000:3.0:1788612627.034441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914420608:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612627.034498:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2395:x1875495914420608:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.034517:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 396 00000100:00100000:3.0:1788612627.034546:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420864 00000100:00100000:3.0:1788612627.034550:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420864 00000100:00100000:3.0:1788612627.034573:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914421376 00000100:00100000:3.0:1788612627.034576:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914421376 00000100:00100000:3.0:1788612627.034590:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914420736 00000100:00100000:3.0:1788612627.034593:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914420736 00000100:00100000:3.0:1788612627.034617:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914421248 00000100:00100000:3.0:1788612627.034620:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914421248 00000100:00100000:3.0:1788612627.034650:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 361 00000100:00100000:3.0:1788612627.034657:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914420864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612627.034685:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2395:x1875495914420864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.034691:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 361 00000100:00100000:3.0:1788612627.034702:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 362 00000100:00100000:3.0:1788612627.034708:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914421376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612627.034729:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+5:2395:x1875495914421376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.034736:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 362 00000100:00100000:3.0:1788612627.034762:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:3.0:1788612627.034769:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2395:x1875495914420736:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612627.034793:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:2395:x1875495914420736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.034799:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:3.0:1788612627.034810:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00100000:3.0:1788612627.034816:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+6:2395:x1875495914421248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612627.034839:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:449720ee-67e1-48cb-85d0-ee79593410d8+6:2395:x1875495914421248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.034844:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00080000:2.0:1788612627.035775:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612627.035782:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612627.035785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612627.035787:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612627.413582:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.413684:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914421632 00000100:00100000:1.0:1788612627.413693:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914421632 00000100:00100000:1.0:1788612627.413752:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1788612627.413763:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+18:13176:x1875495914421632:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:1.0:1788612627.415295:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:13176:x1875495914421632:12345-192.168.203.30@tcp:35:umount.0 Request processed in 1524us (1713us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788612627.415307:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1788612627.427444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612627.427732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914421888 00000100:00100000:3.0:1788612627.427742:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914421888 00000100:00100000:3.0:1788612627.427914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788612627.427925:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+19:13176:x1875495914421888:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:3.0:1788612627.428262:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:13176:x1875495914421888:12345-192.168.203.30@tcp:35:umount.0 Request processed in 337us (826us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788612627.428270:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:2.0:1788612627.431647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.431771:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914422144 00000100:00100000:1.0:1788612627.431780:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914422144 00000100:00100000:1.0:1788612627.431844:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:1.0:1788612627.431854:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c82e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+20:13176:x1875495914422144:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:1.0:1788612627.432085:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c82e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:13176:x1875495914422144:12345-192.168.203.30@tcp:35:umount.0 Request processed in 232us (445us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788612627.432092:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1788612627.437266:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.437350:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914422400 00000100:00100000:1.0:1788612627.437361:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914422400 00000100:00100000:1.0:1788612627.437419:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1788612627.437430:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:13176:x1875495914422400:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:1.0:1788612627.437743:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:13176:x1875495914422400:12345-192.168.203.30@tcp:35:umount.0 Request processed in 314us (487us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788612627.437751:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1788612627.441914:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612627.441951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612627.441978:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612627.442145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612627.442179:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914422528 00000100:00100000:0.0:1788612627.442189:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914422528 00000100:00100000:0.0:1788612627.442255:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914422912 00000100:00100000:0.0:1788612627.442259:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914422912 00000100:00100000:0.0:1788612627.442276:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914422784 00000100:00100000:0.0:1788612627.442278:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914422784 00000100:00100000:0.0:1788612627.442292:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1788612627.442300:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+15:2396:x1875495914422528:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612627.442316:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612627.442334:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc8029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2204d expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612627.442351:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612627.442394:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+14:2396:x1875495914422528:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612627.442413:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1788612627.442430:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612627.442435:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+13:2396:x1875495914422912:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612627.442442:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612627.442451:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc827c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22126 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612627.442460:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612627.442603:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914422656 00000100:00100000:1.0:1788612627.442607:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914422656 00000100:00100000:1.0:1788612627.442645:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:1.0:1788612627.442652:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2393:x1875495914422656:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:1.0:1788612627.442673:0:8543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc837f 00000100:00080000:1.0:1788612627.442681:0:8543:0:(import.c:65:import_set_state_nolock()) ffff9611c7b91800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612627.442722:0:8543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788612627.442851:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+2:2393:x1875495914422656:12345-192.168.203.30@tcp:9:umount.0 Request processed in 199us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.442857:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00010000:00010000:1.0:1788612627.442877:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612627.442912:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:1.0:1788612627.442920:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:2396:x1875495914422784:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612627.442927:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612627.442937:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe924000/0x1f8616bf0bc7fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2200e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.442946:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612627.442962:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:2396:x1875495914422784:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 43us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.442968:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1788612627.444380:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2396:x1875495914422912:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1936us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612627.444393:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612627.449613:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.449756:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914423296 00000100:00100000:1.0:1788612627.449765:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914423296 00000100:00100000:1.0:1788612627.449822:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:1.0:1788612627.449833:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+7:2393:x1875495914423296:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:1.0:1788612627.449864:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc85f5 00000020:00010000:1.0:1788612627.449872:0:8440:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c80c4800: total 0 00000100:00080000:1.0:1788612627.449876:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9611c80c5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612627.449939:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788612627.450126:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2393:x1875495914423296:12345-192.168.203.30@tcp:9:umount.0 Request processed in 294us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.450134:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000020:00010000:2.0:1788612627.450823:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c80c4800: total 0 00010000:00010000:2.0:1788612627.450865:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c80c4800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788612627.450917:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f998cfca/0x1f8616bf0bc907c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224f3 expref: 4 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612627.450954:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc89ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22310 expref: 3 pid: 8543 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612627.450968:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c80c4800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788612627.450981:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612627.450983:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612627.450985:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612627.459445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612627.459574:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914424320 00000100:00100000:3.0:1788612627.459583:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914424320 00000100:00100000:3.0:1788612627.459765:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:3.0:1788612627.459776:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+22:2393:x1875495914424320:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:3.0:1788612627.459809:0:12327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7fb2 00000020:00010000:3.0:1788612627.459823:0:12327:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c6b30800: total 0 00000100:00080000:3.0:1788612627.459828:0:12327:0:(import.c:65:import_set_state_nolock()) ffff9611c6b35800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612627.459859:0:12327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1788612627.459883:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c6b30800: total 0 00010000:00010000:1.0:1788612627.459888:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612627.459954:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c6b30800, canceled 0 locks, left on hash table 13. 00000100:00100000:3.0:1788612627.460034:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+21:2393:x1875495914424320:12345-192.168.203.30@tcp:39:umount.0 Request processed in 259us (597us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788612627.460043:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00010000:00010000:1.0:1788612627.460055:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9611c76e7200) 00010000:00010000:1.0:1788612627.460060:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612627.460069:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc82de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22134 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460101:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612627.460103:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788612627.460107:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799bc00/0x1f8616bf0bc8a32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22333 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460175:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612627.460179:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612627.460184:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bc903d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224de expref: 18 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460209:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612627.460213:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612627.460217:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36400/0x1f8616bf0bc888e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222c3 expref: 17 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460230:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9612c4d8b000) 00010000:00010000:1.0:1788612627.460246:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612627.460251:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a400/0x1f8616bf0bc8d1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2240c expref: 16 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460268:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:1.0:1788612627.460271:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612627.460274:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799ac00/0x1f8616bf0bc8a16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2232c expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460285:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612627.460287:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788612627.460291:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37e00/0x1f8616bf0bc9067 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224ec expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460305:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612627.460307:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788612627.460311:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612fe924e00/0x1f8616bf0bc8355 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22150 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460323:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612627.460325:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788612627.460328:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bc8998 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22309 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460338:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9612c8ef5500) 00010000:00010000:1.0:1788612627.460340:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612627.460343:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc8650 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22229 expref: 11 pid: 8253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460373:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c76e7600) 00010000:00010000:1.0:1788612627.460375:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612627.460380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f5c00/0x1f8616bf0bc82fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2213b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460396:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9611c67a4c00) 00010000:00010000:1.0:1788612627.460399:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612627.460402:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a200/0x1f8616bf0bc896e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d222fb expref: 9 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460415:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9612c4d8b700) 00010000:00010000:1.0:1788612627.460417:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612627.460421:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896a00/0x1f8616bf0bc8f5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224a6 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612627.460433:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c6b30800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788612627.460449:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612627.460450:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612627.460452:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612627.467854:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612627.468074:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914424448 00000100:00100000:1.0:1788612627.468084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914424448 00000100:00100000:1.0:1788612627.468445:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:1.0:1788612627.468458:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+5:2393:x1875495914424448:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:1.0:1788612627.468538:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7fb9 00000100:00080000:1.0:1788612627.468555:0:6523:0:(import.c:65:import_set_state_nolock()) ffff961301689800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612627.468575:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788612627.468746:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1800c7e-b9d8-4080-b6d8-c71cdf3d497c+3:2393:x1875495914424448:12345-192.168.203.30@tcp:39:umount.0 Request processed in 278us (888us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788612627.468767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00010000:00010000:0.0:1788612627.468821:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612627.823901:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612627.954645:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932293888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612627.954720:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612627.954805:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612627.954812:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612627.954835:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612627.954971:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932293888 00000100:00100000:3.0:1788612627.954979:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932293888 00000100:00100000:3.0:1788612627.955036:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294016 00000100:00100000:3.0:1788612627.955039:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294016 00000100:00100000:3.0:1788612627.955056:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788612627.955064:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932293888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612627.955092:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612627.955137:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932293888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.955144:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788612627.955175:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788612627.955182:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932294016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612627.955191:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612627.955230:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932294016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612627.955236:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788612627.955414:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932294272:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955444:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.955462:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932294784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955508:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.955523:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932295296:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.955572:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788612627.955578:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932294144:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955603:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.955624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932294656:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955645:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.955659:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932295168:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955681:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.955706:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294272 00000100:00100000:2.0:1788612627.955710:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294272 00000100:00100000:2.0:1788612627.955752:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294784 00000100:00100000:2.0:1788612627.955755:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294784 00000100:00100000:2.0:1788612627.955773:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295296 00000100:00100000:2.0:1788612627.955776:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295296 00000100:00100000:2.0:1788612627.955791:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788612627.955797:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955833:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932294272:12345-0@lo:400:kworker.0 Request processed in 36us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612627.955839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788612627.955854:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788612627.955860:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955885:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932294784:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612627.955890:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788612627.955901:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788612627.955906:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932295296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932295296:12345-0@lo:400:kworker.0 Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612627.955949:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788612627.955967:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932294528:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.955991:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.956007:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932295040:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956026:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.956040:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788612627.956045:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932294400:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956064:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.956078:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932294912:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956096:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.956105:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932295424:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612627.956140:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294528 00000100:00100000:2.0:1788612627.956143:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294528 00000100:00100000:2.0:1788612627.956159:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294912 00000100:00100000:2.0:1788612627.956161:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294912 00000100:00100000:2.0:1788612627.956173:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295424 00000100:00100000:2.0:1788612627.956176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295424 00000100:00100000:2.0:1788612627.956189:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788612627.956208:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932294528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956242:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932294528:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612627.956248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788612627.956259:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788612627.956273:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956301:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932294912:12345-0@lo:400:kworker.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612627.956307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788612627.956318:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788612627.956324:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932295424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956348:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932295424:12345-0@lo:400:kworker.0 Request processed in 24us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612627.956353:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00080000:2.0:1788612627.956385:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fed71880 x1875495932294912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612627.956398:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932294912:0@lo:400:kworker.0 00010000:00080000:2.0:1788612627.956408:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fe941180 x1875495932295424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612627.956417:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932295424:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956426:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932294528:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956460:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932294272:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956469:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932294784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612627.956502:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932295296:0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.956674:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294144 00000100:00100000:1.0:1788612627.956679:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294144 00000100:00100000:1.0:1788612627.956719:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788612627.956726:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932294144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.956778:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3649:x1875495932294144:12345-0@lo:400:kworker.0 Request processed in 53us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.956785:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788612627.956813:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295168 00000100:00100000:1.0:1788612627.956816:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295168 00000100:00100000:1.0:1788612627.956838:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295040 00000100:00100000:1.0:1788612627.956841:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295040 00000100:00100000:1.0:1788612627.956859:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788612627.956865:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932295168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.956894:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932295168:12345-0@lo:400:kworker.0 Request processed in 29us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.956900:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788612627.956911:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788612627.956917:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932295040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.956946:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932295040:12345-0@lo:400:kworker.0 Request processed in 29us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.956952:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788612627.956967:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294656 00000100:00100000:1.0:1788612627.956970:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294656 00000100:00100000:1.0:1788612627.956986:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932294400 00000100:00100000:1.0:1788612627.956988:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932294400 00000100:00100000:1.0:1788612627.957011:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788612627.957017:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932294656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.957049:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932294656:12345-0@lo:400:kworker.0 Request processed in 32us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.957054:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788612627.957066:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788612627.957071:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932294400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.957096:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932294400:12345-0@lo:400:kworker.0 Request processed in 25us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612627.957102:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788612627.957126:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932294400:0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.957137:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932295040:0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.957161:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932294144:0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.957171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932294656:0@lo:400:kworker.0 00000100:00100000:1.0:1788612627.957181:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932295168:0@lo:400:kworker.0 00000100:00080000:0.0:1788612627.957400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612627.957405:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612627.957407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612627.957409:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612627.957442:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612627.957457:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c12ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932293888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612628.463903:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612628.463926:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932295552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612628.463989:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612628.464199:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932295680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612628.464228:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612628.464295:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295680 00000100:00100000:3.0:1788612628.464302:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295680 00000100:00100000:3.0:1788612628.464350:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788612628.464358:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932295680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612628.464383:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788612628.464426:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932295680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612628.464432:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788612628.464469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932295680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612628.464679:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295552 00000100:00100000:1.0:1788612628.464684:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295552 00000100:00100000:1.0:1788612628.464719:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788612628.464725:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932295552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612628.464753:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788612628.464797:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932295552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612628.464803:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788612628.464921:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932295552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612628.465032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612628.465041:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932295808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612628.465066:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612628.465134:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295808 00000100:00100000:0.0:1788612628.465138:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295808 00000100:00100000:0.0:1788612628.465168:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788612628.465174:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932295808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612628.465291:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788612628.465331:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932295808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612628.465337:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788612628.465394:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932295808:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788612628.852759:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612629.324233:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612629.324271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612629.324300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612629.324382:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914424576 00000100:00100000:1.0:1788612629.324406:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914424576 00000100:00100000:1.0:1788612629.324467:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914424832 00000100:00100000:1.0:1788612629.324471:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914424832 00000100:00100000:1.0:1788612629.324517:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914424704 00000100:00100000:1.0:1788612629.324521:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914424704 00000100:00100000:1.0:1788612629.324537:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1788612629.324546:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9281450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+12:2397:x1875495914424576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612629.324559:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612629.324577:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0031a00/0x1f8616bf0bc80b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22062 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612629.324596:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612629.324656:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9281450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+11:2397:x1875495914424576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 110us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612629.324663:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1788612629.324707:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1788612629.324714:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+10:2397:x1875495914424832:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612629.324721:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612629.324730:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc8275 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2211f expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612629.324739:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612629.324755:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+9:2397:x1875495914424832:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612629.324761:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1788612629.324774:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1788612629.324780:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+8:2397:x1875495914424704:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612629.324796:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612629.324805:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe925400/0x1f8616bf0bc80bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22093 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612629.324813:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612629.324831:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4a7b63b-1ca3-448d-b4ff-632109d126dc+7:2397:x1875495914424704:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 51us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612629.324837:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612629.334133:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612629.334764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425088 00000100:00100000:2.0:1788612629.334775:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425088 00000100:00100000:2.0:1788612629.334907:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:2.0:1788612629.334930:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+6:2393:x1875495914425088:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:2.0:1788612629.337505:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc80ca 00000020:00010000:2.0:1788612629.337526:0:6525:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c7a69800: total 0 00000100:00080000:2.0:1788612629.337533:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9611c7a6f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612629.337558:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788612629.337758:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:449720ee-67e1-48cb-85d0-ee79593410d8+5:2393:x1875495914425088:12345-192.168.203.30@tcp:39:umount.0 Request processed in 2837us (3628us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788612629.337769:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00080000:0.0:1788612629.337857:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1788612629.338911:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c7a69800: total 0 00010000:00010000:1.0:1788612629.338987:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c7a69800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788612629.339036:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c4d8b900) 00010000:00010000:1.0:1788612629.339039:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612629.339050:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bc908a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d224fa expref: 4 pid: 12327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612629.339074:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c7a69800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788612629.339086:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612629.339088:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612629.339090:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788612629.340919:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00080000:1.0:1788612629.340948:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788612629.340952:0:6502:0:(genops.c:885:class_export_put()) final put ffff9611c7a69800/449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00100000:1.0:1788612629.340974:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000001:00080000:1.0:1788612629.340980:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788612629.340986:0:6502:0:(genops.c:885:class_export_put()) final put ffff9611c6b30800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:0.0:1788612629.341046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a69800/449720ee-67e1-48cb-85d0-ee79593410d8 for lustre-MDT0000 00000020:00000080:0.0:1788612629.341100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6b30800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-MDT0000 00000020:00000080:0.0:1788612629.341126:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7a6f800 for lustre-MDT0000 00000020:00000080:0.0:1788612629.341131:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c6b35800 for lustre-MDT0000 00000100:00100000:0.0:1788612629.355691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612629.355820:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425216 00000100:00100000:1.0:1788612629.355830:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425216 00000100:00100000:1.0:1788612629.355931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:1.0:1788612629.355961:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+5:2393:x1875495914425216:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:1.0:1788612629.356137:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc80d1 00000100:00080000:1.0:1788612629.356157:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9611c7a68000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612629.356196:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788612629.356298:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612629.356349:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:449720ee-67e1-48cb-85d0-ee79593410d8+3:2393:x1875495914425216:12345-192.168.203.30@tcp:39:umount.0 Request processed in 389us (670us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788612629.356356:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00080000:0.0:1788612629.356935:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612629.383121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612629.383245:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425472 00000100:00100000:1.0:1788612629.383255:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425472 00000100:00100000:1.0:1788612629.383366:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 398 00000100:00100000:1.0:1788612629.383376:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+7:2393:x1875495914425472:12345-192.168.203.30@tcp:251:umount.0 00000020:00000080:1.0:1788612629.383422:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f8f 00000020:00010000:1.0:1788612629.383430:0:6516:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c7934000: total 0 00000100:00080000:1.0:1788612629.383435:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9611c7936800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788612629.383543:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4a7b63b-1ca3-448d-b4ff-632109d126dc+3:2393:x1875495914425472:12345-192.168.203.30@tcp:251:umount.0 Request processed in 168us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612629.383552:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 398 00000020:00010000:3.0:1788612629.383613:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c7934000: total 0 00010000:00010000:3.0:1788612629.383617:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612629.383667:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c7934000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788612629.383699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d0200/0x1f8616bf0bc8068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22054 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612629.383734:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c7934000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788612629.383745:0:6511:0:(genops.c:885:class_export_put()) final put ffff9611c7934000/a4a7b63b-1ca3-448d-b4ff-632109d126dc 00010000:00010000:3.0:1788612629.383757:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612629.383759:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612629.383760:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788612629.383769:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7934000/a4a7b63b-1ca3-448d-b4ff-632109d126dc for MGS 00000020:00000080:3.0:1788612629.383801:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7936800 for MGS 00010000:00010000:2.0:1788612629.871661:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612630.898266:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788612631.325811:0:15207:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788612631.350139:0:15207:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788612631.350227:0:15207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.350247:0:15207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.350255:0:15207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.350283:0:15207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.350309:0:15207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788612631.350315:0:15207:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788612631.350347:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612631.350354:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.353707:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe924c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612631.353716:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.353729:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612631.353738:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612631.353744:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612631.353747:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788612631.353752:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788612631.353824:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.353832:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612631.353875:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.353884:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe924c00/0x1f8616bf0bc803e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8045 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.353921:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612631.353923:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612631.353926:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612631.353951:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932295936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612631.359122:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612631.360526:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612631.360536:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612631.360545:0:15207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612631.360587:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612fcc3b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788612631.363026:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932295936 00000100:00100000:1.0:1788612631.363043:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932295936 00000100:00100000:1.0:1788612631.363203:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612631.363216:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+24:3650:x1875495932295936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612631.363235:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612631.363261:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1200/0x1f8616bf0bc8045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc803e expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612631.363281:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612631.363394:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932295936:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (9355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612631.363415:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612631.363462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932296064:0@lo:39:umount.0 00000100:00100000:1.0:1788612631.363530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612631.363828:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932295936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612631.363929:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296064 00000100:00100000:2.0:1788612631.363935:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296064 00000100:00100000:2.0:1788612631.363981:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788612631.363989:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875495932296064:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788612631.364018:0:8253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7ba6 00000100:00080000:2.0:1788612631.364029:0:8253:0:(import.c:65:import_set_state_nolock()) ffff9612ea251800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788612631.364104:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875495932296064:12345-0@lo:39:umount.0 Request processed in 115us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612631.364111:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788612631.364120:0:8253:0:(genops.c:885:class_export_put()) final put ffff9612ea257800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788612631.364147:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea257800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788612631.364206:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612ea251800 for lustre-MDT0000 00010000:00010000:1.0:1788612631.364289:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612631.364312:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fcc3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788612631.364332:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932296064:0@lo:39:umount.0 00000100:00080000:2.0:1788612631.364431:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612631.364436:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612631.364441:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788612631.365953:0:15207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.365997:0:15207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.366005:0:15207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.366013:0:15207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.366082:0:15207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612631.366090:0:15207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.366098:0:15207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.366106:0:15207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.366112:0:15207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366222:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612631.366231:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366239:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612631.366244:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366255:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612631.366276:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612631.366282:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612631.366285:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788612631.366331:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366339:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788612631.366404:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788612631.366425:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366434:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc804c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8053 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366461:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612631.366465:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366471:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612631.366499:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366507:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612631.366514:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612631.366519:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612631.366527:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788612631.366542:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366548:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612631.366580:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366589:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612631.366591:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612631.366593:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612631.366612:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932296320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612631.366692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612631.366772:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296320 00000100:00100000:0.0:1788612631.366781:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296320 00000100:00100000:0.0:1788612631.366835:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612631.366845:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3648:x1875495932296320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612631.366859:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612631.366876:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2e00/0x1f8616bf0bc7f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc7f49 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.366890:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612631.366928:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:3648:x1875495932296320:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612631.366936:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612631.366977:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932296320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612631.367971:0:15207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612631.367984:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3200/0x1f8616bf0bc7f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7f50 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612631.368000:0:15207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788612631.368015:0:15207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368044:0:15207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368051:0:15207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368059:0:15207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368129:0:15207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612631.368137:0:15207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368146:0:15207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368152:0:15207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612631.368158:0:15207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612631.368246:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932296192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612631.368310:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612631.368439:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612631.368453:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368590:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612631.368596:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368605:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612631.368613:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612631.368619:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788612631.368622:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788612631.368624:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788612631.368657:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368665:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788612631.368712:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932296448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612631.368753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612631.368854:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368863:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc82ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc82b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368875:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612631.368879:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368885:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612631.368889:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368903:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612631.368909:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612631.368915:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612631.368917:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788612631.368930:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368936:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612631.368952:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.368960:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612631.368962:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612631.368964:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612631.368981:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296192 00000100:00100000:0.0:1788612631.368987:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296192 00000100:00100000:0.0:1788612631.369031:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296448 00000100:00100000:0.0:1788612631.369034:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296448 00000100:00100000:0.0:1788612631.369056:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612631.369065:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+23:3650:x1875495932296192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612631.369078:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612631.369092:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc8053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc804c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.369106:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612631.369150:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+22:3650:x1875495932296192:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612631.369158:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612631.369185:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612631.369192:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+21:3649:x1875495932296448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612631.369200:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612631.369208:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc82b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc82ad expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.369218:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612631.369722:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612631.369806:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3649:x1875495932296448:12345-0@lo:103:ldlm_bl.0 Request processed in 613us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612631.369814:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612631.369846:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612631.369856:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932296576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612631.369893:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612631.369935:0:10342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296576 00000100:00100000:0.0:1788612631.369940:0:10342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296576 00000100:00100000:0.0:1788612631.369968:0:10342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612631.369976:0:10342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c9282850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+20:3651:x1875495932296576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612631.369984:0:10342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612631.369995:0:10342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc7b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc7b05 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612631.370008:0:10342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612631.370036:0:10342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c9282850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3651:x1875495932296576:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612631.370042:0:10342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612631.370119:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932296576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612631.370148:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932296192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612631.370255:0:15207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612631.370263:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f4a00/0x1f8616bf0bc7b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7b0c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612631.370276:0:15207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788612631.370281:0:15207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788612631.370285:0:15207:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788612631.370335:0:15207:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788612631.370340:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788612631.370345:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612631.370352:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788612631.370421:0:15207:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff961301689000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612631.370429:0:15207:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9612fe9f5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612631.370434:0:15207:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9612fcfb1000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612631.370439:0:15207:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9612fcd0b800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788612631.370443:0:15207:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9612d1e60000) has exports, disconnecting them 00000020:00080000:2.0:1788612631.370561:0:15207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff961301689000), last request at 1788612627 00000020:00000080:2.0:1788612631.370633:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7eb6 00000100:00080000:2.0:1788612631.370655:0:15207:0:(import.c:65:import_set_state_nolock()) ffff96130168f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788612631.370776:0:15207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961301689000): rc 0 00000020:00000080:2.0:1788612631.370779:0:15207:0:(genops.c:885:class_export_put()) final put ffff961301689000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788612631.370791:0:15207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9612fe9f5800), last request at 1788612627 00000020:00000080:2.0:1788612631.370795:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7d90 00000100:00080000:2.0:1788612631.370801:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612fe9f4800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788612631.370818:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612631.370884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932296448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612631.370930:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788612631.370991:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961301689000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788612631.371083:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788612631.371123:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130168f000 for lustre-MDT0000 00000020:00080000:2.0:1788612631.371140:0:15207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612fe9f5800): rc 0 00000020:00000080:2.0:1788612631.371142:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612fe9f5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788612631.371190:0:15207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9612fcfb1000), last request at 1788612401 00000020:00000080:2.0:1788612631.371194:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c8d 00000100:00080000:2.0:1788612631.371199:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612fcfb6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788612631.371242:0:15207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612fcfb1000): rc 0 00000020:00000080:2.0:1788612631.371244:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612fcfb1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788612631.371263:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fe9f5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788612631.371312:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fe9f4800 for lustre-MDT0000 00010000:00010000:1.0:1788612631.371421:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788612631.371709:0:15207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9612fcd0b800), last request at 1788612401 00000020:00000080:2.0:1788612631.371727:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c4e 00000100:00080000:2.0:1788612631.371731:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612fcfb5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612631.371751:0:15207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788612631.371859:0:15207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612fcd0b800): rc 0 00000004:00000080:2.0:1788612631.371867:0:15207:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9b940e33ae0 00000100:00080000:2.0:1788612631.371890:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788612631.371894:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1788612631.372446:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788612631.373040:0:15207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788612631.373074:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612c71e2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788612631.373139:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932296704:0@lo:39:umount.0 00000100:00100000:0.0:1788612631.373232:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788612631.373381:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788612631.373467:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fcfb6000 for lustre-MDT0000 00000100:00100000:0.0:1788612631.373985:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296704 00000100:00100000:0.0:1788612631.373996:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296704 00000100:00100000:0.0:1788612631.374062:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788612631.374074:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875495932296704:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788612631.374106:0:6529:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7ce8 00000100:00080000:0.0:1788612631.374115:0:6529:0:(import.c:65:import_set_state_nolock()) ffff9612fe89c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612631.374147:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1788612631.375501:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612631.376846:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3647:x1875495932296704:12345-0@lo:39:umount.0 Request processed in 2763us (3604us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788612631.376863:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1788612631.378668:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c71e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788612631.378689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932296704:0@lo:39:umount.0 00000100:00080000:2.0:1788612631.379417:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788612631.379424:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788612631.379445:0:15207:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788612631.379846:0:15207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788612631.379886:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612c92f3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788612631.379913:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788612631.379916:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788612631.379925:0:15207:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788612631.379986:0:15207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788612631.379996:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9611c78b4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788612631.380033:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9612d1e60000) has no exports 00000100:00100000:1.0:1788612631.380153:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932296832:0@lo:9:umount.0 00000100:00100000:1.0:1788612631.380262:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612631.380313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932296960:0@lo:9:umount.0 00000100:00100000:1.0:1788612631.380338:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612631.380400:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296832 00000100:00100000:1.0:1788612631.380410:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296832 00000100:00100000:1.0:1788612631.380509:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932296960 00000100:00100000:1.0:1788612631.380513:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932296960 00000100:00100000:1.0:1788612631.380542:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612631.380553:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875495932296832:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788612631.380594:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7e38 00000100:00080000:1.0:1788612631.380604:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9612fe9f4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612631.380660:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788612631.380833:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3647:x1875495932296832:12345-0@lo:9:umount.0 Request processed in 282us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612631.380842:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612631.380861:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612631.380868:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875495932296960:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788612631.380880:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f7a 00000100:00080000:1.0:1788612631.380887:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9611c68f8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612631.380910:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788612631.380992:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3647:x1875495932296960:12345-0@lo:9:umount.0 Request processed in 124us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612631.380999:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788612631.381043:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c92f3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788612631.381052:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788612631.381055:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612631.381058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932296832:0@lo:9:umount.0 00000100:00080000:1.0:1788612631.381070:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c78b4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788612631.381073:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788612631.381075:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612631.381077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932296960:0@lo:9:umount.0 00010000:00010000:3.0:1788612631.381240:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788612631.382603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612631.382613:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788612631.383694:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788612631.398017:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9612d1e60000) has no exports 00000020:00000080:2.0:1788612631.450348:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b60 00000020:00000080:2.0:1788612631.450363:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c909e800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788612631.450455:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788612631.450725:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612631.450743:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788612631.450750:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9612c93eb380) has no exports 00000020:00000080:3.0:1788612631.452023:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b59 00000020:00000080:3.0:1788612631.452039:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612f7afb000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788612631.452726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c909e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788612631.452747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7afb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788612631.452827:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612631.452847:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788612631.452853:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612f7afa800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788612631.452879:0:15207:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7afa800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788612631.452892:0:15207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1788612631.535898:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612631.535935:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932297088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612631.536037:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612631.536427:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297088 00000100:00100000:2.0:1788612631.536440:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297088 00000100:00100000:2.0:1788612631.536518:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788612631.536528:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875495932297088:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788612631.536554:0:6528:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788612631.536634:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875495932297088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (597us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788612631.536642:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:02020000:3.0:1788612631.536706:0:3650:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788612631.553833:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788612631.553844:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788612631.553850:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788612631.573506:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612631.573526:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 215 00000100:00080000:3.0:1788612631.573541:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9612c71e0800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612631.573646:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c81fc380 x1875495932297216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612631.577048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932297216:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788612631.577167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612631.578659:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297216 00000100:00100000:2.0:1788612631.578675:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297216 00000100:00100000:2.0:1788612631.578723:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788612631.578731:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932297216:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788612631.578750:0:6528:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788612631.585920:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932297216:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 7181us (8746us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612631.585935:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:1.0:1788612631.586433:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612631.586441:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612631.586446:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932297216:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788612631.919765:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612632.943685:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612633.072270:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788612633.072296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612633.072302:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612633.072307:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612633.072317:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 445 00000100:00080000:3.0:1788612633.072325:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612633.072333:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9612c71e0800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612633.072365:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c81fed80 x1875495932297472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612633.072465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932297472:0@lo:38:kworker.0 00000100:00100000:0.0:1788612633.072469:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612633.072511:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932297600:0@lo:400:kworker.0 00000100:00100000:1.0:1788612633.075553:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788612633.075987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932297728:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.076547:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.077059:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932297856:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.077125:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.077154:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932298368:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.077191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.077244:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297856 00000100:00100000:2.0:1788612633.077251:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297856 00000100:00100000:2.0:1788612633.077327:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788612633.077350:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932297856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612633.077350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.077379:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.077425:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932297984:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.077462:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932297856:12345-0@lo:400:kworker.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612633.077463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.077496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.077515:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788612633.077535:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932298496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612633.077548:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297600 00000100:00100000:3.0:1788612633.077559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932298240:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.077571:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297600 00000100:00100000:0.0:1788612633.077573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612633.077606:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.077623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297728 00000100:00100000:2.0:1788612633.077629:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297728 00000100:00100000:2.0:1788612633.077642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298240 00000100:00100000:2.0:1788612633.077644:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298240 00000100:00100000:2.0:1788612633.077666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788612633.077690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932298240:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788612633.077698:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c81fc380 x1875495932297856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612633.077727:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932297856:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.077752:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932298240:12345-0@lo:400:kworker.0 Request processed in 66us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612633.077760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788612633.077774:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788612633.077777:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875495932297600:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788612633.077783:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788612633.077819:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875495932297600:12345-0@lo:400:kworker.0 Request processed in 40us (483us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788612633.077826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788612633.077837:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788612633.077842:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875495932297728:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788612633.077846:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788612633.077874:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875495932297728:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788612633.077881:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788612633.077898:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612633.077918:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298496 00000100:00100000:2.0:1788612633.077925:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298496 00000100:00080000:3.0:1788612633.079360:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612633.079881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297344 00000100:00100000:1.0:1788612633.079896:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297344 00000100:00100000:1.0:1788612633.080050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788612633.080416:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3649:x1875495932297344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612633.080543:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3649:x1875495932297344:12345-0@lo:400:kworker.0 Request processed in 133us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.080551:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788612633.080602:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298368 00000100:00100000:1.0:1788612633.080607:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298368 00000100:00100000:1.0:1788612633.080640:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297984 00000100:00100000:1.0:1788612633.080643:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297984 00000100:00100000:1.0:1788612633.080674:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788612633.080681:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875495932298368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612633.080926:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875495932298368:12345-0@lo:400:kworker.0 Request processed in 245us (3733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.080933:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788612633.080948:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788612633.080955:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932297984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612633.081419:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932297984:12345-0@lo:400:kworker.0 Request processed in 464us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.081428:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1788612633.081457:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612633.081524:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932298368:0@lo:400:kworker.0 00000100:00100000:1.0:1788612633.081628:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932297472 00000100:00100000:1.0:1788612633.081634:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932297472 00000100:00100000:1.0:1788612633.081660:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788612633.081666:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932297472:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788612633.081686:0:6529:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788612633.083766:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788612633.083792:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788612633.083798:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:3.0:1788612633.084335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79a9c00 x1875495932298240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612633.084353:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932298240:0@lo:400:kworker.0 00000100:00080000:3.0:1788612633.084395:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788612633.084399:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788612633.084403:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788612633.084408:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612633.084413:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 236 00000100:00080000:3.0:1788612633.084422:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c6491000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612633.084461:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a9c00 x1875495932298624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612633.084510:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932297728:0@lo:400:kworker.0 00000100:00100000:3.0:1788612633.084559:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932298624:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788612633.085674:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612633.085772:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788612633.085791:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932298496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612633.085848:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788612633.085912:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932298496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (8340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612633.085924:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788612633.085935:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298624 00000100:00100000:2.0:1788612633.085951:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298624 00000100:00100000:2.0:1788612633.086009:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788612633.086015:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d04a0405-b620-42fe-8569-8c55f54b9b5e:3649:1875495932297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788612633.086044:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932298112:0@lo:400:kworker.0 00000100:00100000:3.0:1788612633.086140:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612633.086196:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298112 00000100:00100000:3.0:1788612633.086203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298112 00000100:00100000:2.0:1788612633.086346:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875495932298624:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788612633.086366:0:12327:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788612633.086800:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875495932298624:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 456us (1131us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612633.087264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788612633.087274:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875495932298112:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788612633.087283:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788612633.087341:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875495932298112:12345-0@lo:400:kworker.0 Request processed in 67us (1201us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788612633.087350:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788612633.087404:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788612633.087411:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788612633.087415:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788612633.087421:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612633.087426:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 255 00000100:00080000:3.0:1788612633.087434:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96130066b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612633.087467:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a9880 x1875495932298752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612633.087501:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932298112:0@lo:400:kworker.0 00000100:00100000:2.0:1788612633.087534:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788612633.087595:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932298752:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788612633.087949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612633.087999:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612633.088005:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612633.088008:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932298624:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788612633.088367:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298752 00000100:00100000:2.0:1788612633.088377:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298752 00000100:00100000:2.0:1788612633.088418:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788612633.088425:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932298752:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788612633.089973:0:6523:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788612633.091604:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932298752:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 3171us (3649us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612633.091617:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788612633.091911:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612633.091923:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612633.091929:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932298752:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788612633.092854:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932297472:12345-0@lo:38:kworker.0 Request processed in 11183us (16312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612633.092868:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1788612633.093203:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612633.093210:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612633.093214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932297472:0@lo:38:kworker.0 00000100:00080000:0.0:1788612633.129555:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612633.129573:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 215 00000100:00080000:0.0:1788612633.129585:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96130066d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612633.129658:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7ac8380 x1875495932298880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612633.129697:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932297600:0@lo:400:kworker.0 00000100:00100000:0.0:1788612633.129754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932297984:0@lo:400:kworker.0 00000100:00100000:0.0:1788612633.129776:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932298496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612633.129908:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932298880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788612633.129982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.130454:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932298880 00000100:00100000:0.0:1788612633.130463:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932298880 00000100:00100000:0.0:1788612633.130797:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788612633.130805:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932298880:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788612633.130835:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612633.130899:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932298880:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 93us (916us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612633.130907:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788612633.131032:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612633.131038:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612633.131042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932298880:0@lo:38:ptlrpcd_00_00.0 00000040:00080000:0.0:1788612633.329631:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788612633.583868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932299008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612633.583940:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.585305:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299008 00000100:00100000:0.0:1788612633.585320:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299008 00000100:00100000:0.0:1788612633.585394:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788612633.585404:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932299008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612633.585437:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788612633.585568:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932299008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612633.585576:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788612633.585709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932299008:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788612633.596301:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788612633.596310:0:8434:0:(genops.c:885:class_export_put()) final put ffff9612fe9f3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788612633.596333:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:0.0:1788612633.596335:0:8434:0:(genops.c:885:class_export_put()) final put ffff9611c80c4800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:1.0:1788612633.596472:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fe9f3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788612633.596529:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c80c4800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-OST0000 00000020:00000080:1.0:1788612633.596546:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fe9f4000 for lustre-OST0000 00000020:00000080:1.0:1788612633.596549:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c80c5000 for lustre-OST0000 00000001:00100000:0.0:1788612633.600189:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788612633.600199:0:9518:0:(genops.c:885:class_export_put()) final put ffff9611c68fd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788612633.600224:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:0.0:1788612633.600227:0:9518:0:(genops.c:885:class_export_put()) final put ffff9611c7b91000/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:3.0:1788612633.600284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68fd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788612633.600336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7b91000/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-OST0001 00000020:00000080:3.0:1788612633.600357:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c68f8000 for lustre-OST0001 00000020:00000080:3.0:1788612633.600362:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7b91800 for lustre-OST0001 00000001:00100000:2.0:1788612633.601194:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788612633.601205:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788612633.601209:0:7455:0:(genops.c:885:class_export_put()) final put ffff9612fe89c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788612633.601227:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00080000:2.0:1788612633.601232:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788612633.601234:0:7455:0:(genops.c:885:class_export_put()) final put ffff9611c7a6d800/449720ee-67e1-48cb-85d0-ee79593410d8 00000001:00100000:2.0:1788612633.601238:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000001:00080000:2.0:1788612633.601243:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788612633.601244:0:7455:0:(genops.c:885:class_export_put()) final put ffff9611c6b31800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c 00000020:00000080:1.0:1788612633.601292:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fe89c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788612633.601342:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a6d800/449720ee-67e1-48cb-85d0-ee79593410d8 for lustre-MDT0001 00000020:00000080:1.0:1788612633.601363:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6b31800/e1800c7e-b9d8-4080-b6d8-c71cdf3d497c for lustre-MDT0001 00000020:00000080:1.0:1788612633.601553:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fe89c000 for lustre-MDT0001 00000020:00000080:1.0:1788612633.601558:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7a68000 for lustre-MDT0001 00000020:00000080:1.0:1788612633.601562:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961301689800 for lustre-MDT0001 00010000:00010000:3.0:1788612633.967727:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612634.991964:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612636.015794:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612637.040767:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788612637.682059:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788612637.682071:0:6502:0:(genops.c:885:class_export_put()) final put ffff9612fcd0b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788612637.682170:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcd0b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788612637.682250:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fcfb5000 for lustre-MDT0000 00010000:00010000:3.0:1788612638.064106:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612638.193225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612638.193234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612638.193240:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612638.193249:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 447 00000100:00100000:0.0:1788612638.193252:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932299136:0@lo:400:kworker.0 00000100:00080000:3.0:1788612638.193259:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788612638.193270:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9612c71e0800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612638.193303:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a8000 x1875495932299264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612638.193323:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612638.193327:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612638.193329:0:36:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612638.193334:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788612638.193337:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612638.193342:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96130066d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612638.193357:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a9180 x1875495932299392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612638.193369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612638.193375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1788612638.193377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612638.193378:0:36:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612638.193384:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788612638.193388:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612638.193392:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c6491000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612638.193404:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79abb80 x1875495932299520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612638.193445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612638.193468:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612638.193470:0:36:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612638.193493:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788612638.193496:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612638.193500:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96130066b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612638.193514:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c81fc700 x1875495932299904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612638.193554:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932300032:0@lo:400:kworker.0 00000100:00100000:3.0:1788612638.193590:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612638.193763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932300160:0@lo:400:kworker.0 00000100:00100000:0.0:1788612638.193799:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612638.193822:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612638.193828:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932299648:0@lo:400:kworker.0 00000100:00100000:0.0:1788612638.193853:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612638.194195:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299136 00000100:00100000:1.0:1788612638.194207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299136 00000100:00100000:1.0:1788612638.194275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788612638.194285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932299136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612638.194357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932299136:12345-0@lo:400:kworker.0 Request processed in 73us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612638.194374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788612638.194418:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300160 00000100:00100000:1.0:1788612638.194423:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300160 00000100:00100000:1.0:1788612638.194465:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788612638.194473:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932300160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612638.194544:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932300160:12345-0@lo:400:kworker.0 Request processed in 73us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612638.194550:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788612638.194567:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612638.194609:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932300160:0@lo:400:kworker.0 00000100:00100000:1.0:1788612638.194620:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932299136:0@lo:400:kworker.0 00000100:00100000:2.0:1788612638.195658:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932299264:0@lo:38:kworker.0 00000100:00100000:0.0:1788612638.195813:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300032 00000100:00100000:0.0:1788612638.195822:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300032 00000100:00100000:0.0:1788612638.195880:0:12327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299648 00000100:00100000:0.0:1788612638.195884:0:12327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299648 00000100:00100000:0.0:1788612638.195914:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788612638.195925:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932300032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612638.196002:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932300032:12345-0@lo:400:kworker.0 Request processed in 79us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612638.196010:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788612638.196046:0:12327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788612638.196053:0:12327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932299648:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788612638.196090:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c81fed80 x1875495932300032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612638.196095:0:12327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932299648:12345-0@lo:400:kworker.0 Request processed in 41us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612638.196113:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932300032:0@lo:400:kworker.0 00000100:00100000:0.0:1788612638.196122:0:12327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1788612638.196154:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612638.196173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788612638.196212:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612638.196248:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299776 00000100:00100000:0.0:1788612638.196251:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299776 00000100:00100000:1.0:1788612638.196292:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932300288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612638.196294:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788612638.196305:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932299776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612638.196342:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612638.196348:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932299776:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612638.196356:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1788612638.196387:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612638.196408:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932299776:0@lo:400:kworker.0 00010000:00080000:0.0:1788612638.196451:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79ab100 x1875495932299648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612638.196458:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300288 00000100:00100000:1.0:1788612638.196464:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300288 00000100:00100000:0.0:1788612638.196467:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932299648:0@lo:400:kworker.0 00000100:00100000:1.0:1788612638.196533:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788612638.196541:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932300288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788612638.196569:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788612638.196618:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932300288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612638.196624:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788612638.197333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612638.197384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932299392:0@lo:38:kworker.0 00000100:00100000:2.0:1788612638.197416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612638.197441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932299520:0@lo:38:kworker.0 00000100:00100000:2.0:1788612638.197467:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612638.197507:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c81fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932299904:0@lo:38:kworker.0 00000100:00100000:2.0:1788612638.197533:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612638.197570:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299392 00000100:00100000:2.0:1788612638.197576:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299392 00000100:00100000:2.0:1788612638.197603:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299520 00000100:00100000:2.0:1788612638.197606:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299520 00000100:00100000:2.0:1788612638.197619:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299904 00000100:00100000:2.0:1788612638.197622:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299904 00000100:00100000:2.0:1788612638.197634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788612638.197640:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932299392:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788612638.197659:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612638.197927:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932300288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612638.197975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788612638.197981:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932299520:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788612638.197991:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612638.198039:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932299520:12345-0@lo:38:kworker.0 Request processed in 57us (571us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612638.198047:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788612638.198076:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788612638.198081:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932299904:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788612638.198089:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612638.198115:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932299904:12345-0@lo:38:kworker.0 Request processed in 33us (582us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612638.198121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788612638.198688:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932299264 00000100:00100000:1.0:1788612638.198696:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932299264 00000100:00100000:1.0:1788612638.198741:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788612638.198756:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932299264:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788612638.198768:0:6529:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788612638.198810:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932299264:12345-0@lo:38:kworker.0 Request processed in 54us (1478us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612638.198817:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1788612638.198863:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612638.198870:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612638.198874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932299264:0@lo:38:kworker.0 00000100:00080000:1.0:1788612638.198887:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612638.198891:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612638.198894:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932299520:0@lo:38:kworker.0 00000100:00080000:1.0:1788612638.198904:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612638.198908:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612638.198911:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c81fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932299904:0@lo:38:kworker.0 00000100:00100000:2.0:1788612638.210782:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932299392:12345-0@lo:38:kworker.0 Request processed in 13124us (13349us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612638.210804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1788612638.211705:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612638.211717:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612638.211723:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932299392:0@lo:38:kworker.0 00000100:00100000:3.0:1788612638.707259:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612638.707293:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932300416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612638.707396:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612638.707691:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300416 00000100:00100000:0.0:1788612638.707702:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300416 00000100:00100000:0.0:1788612638.707775:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788612638.707787:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932300416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612638.707824:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788612638.707887:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932300416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612638.707895:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788612638.708336:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fe943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932300416:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788612639.088285:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612640.111724:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612641.136802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612642.161104:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612643.183707:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612643.312053:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932300544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612643.312163:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612643.312372:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300544 00000100:00100000:2.0:1788612643.312383:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300544 00000100:00100000:2.0:1788612643.312506:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788612643.312520:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932300544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612643.312556:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788612643.312613:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932300544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612643.312620:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788612643.312808:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612643.312871:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932300544:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788612643.313129:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612643.313135:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612643.313140:0:484:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612643.313146:0:484:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788612643.313151:0:484:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788612643.313157:0:484:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9612c71e0800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612643.313183:0:484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79abb80 x1875495932300800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612643.313220:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612643.313224:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612643.313226:0:484:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612643.313230:0:484:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788612643.313232:0:484:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612643.313236:0:484:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96130066d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612643.313251:0:484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a8000 x1875495932300928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612643.313260:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612643.313264:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612643.313265:0:484:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612643.313268:0:484:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788612643.313271:0:484:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612643.313274:0:484:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c6491000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612643.313285:0:484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79ab100 x1875495932301056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612643.313316:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612643.313319:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612643.313321:0:484:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612643.313325:0:484:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788612643.313327:0:484:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612643.313331:0:484:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96130066b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612643.313343:0:484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc6680 x1875495932301440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612643.313381:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788612643.313623:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932300800:0@lo:38:kworker.0 00000100:00100000:3.0:1788612643.313669:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612643.313698:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932300928:0@lo:38:kworker.0 00000100:00100000:3.0:1788612643.313723:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612643.313745:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932301056:0@lo:38:kworker.0 00000100:00100000:3.0:1788612643.313764:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612643.313778:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932301440:0@lo:38:kworker.0 00000100:00100000:3.0:1788612643.313797:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612643.313825:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788612643.313848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612643.313879:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300928 00000100:00100000:3.0:1788612643.313885:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300928 00000100:00100000:3.0:1788612643.313914:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301056 00000100:00100000:3.0:1788612643.313917:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301056 00000100:00100000:3.0:1788612643.313925:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301440 00000100:00100000:3.0:1788612643.313927:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301440 00000100:00100000:3.0:1788612643.313935:0:8253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301568 00000100:00100000:3.0:1788612643.313938:0:8253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301568 00000100:00100000:3.0:1788612643.313969:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788612643.313979:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932301568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612643.314026:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932301568:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612643.314033:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788612643.314050:0:8253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788612643.314054:0:8253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875495932300928:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788612643.314098:0:8253:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612643.314832:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300800 00000100:00100000:0.0:1788612643.314842:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300800 00000100:00100000:0.0:1788612643.314881:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788612643.314889:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932300800:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788612643.314901:0:6528:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612643.314962:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932300800:12345-0@lo:38:kworker.0 Request processed in 73us (1292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612643.314969:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788612643.314995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788612643.315000:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932301056:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788612643.315008:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612643.315037:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932301056:12345-0@lo:38:kworker.0 Request processed in 36us (1272us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612643.315056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788612643.315073:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788612643.315077:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932301440:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788612643.315103:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612643.315130:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932301440:12345-0@lo:38:kworker.0 Request processed in 52us (1332us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612643.315136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788612643.315178:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932300672:0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.315220:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612643.315261:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612643.315268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932301184:0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.315296:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612643.315323:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301184 00000100:00100000:0.0:1788612643.315327:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301184 00000100:00100000:0.0:1788612643.315362:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788612643.315368:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932301184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.315419:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fe943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932301184:12345-0@lo:400:kworker.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612643.315426:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00080000:0.0:1788612643.315471:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c79aad80 x1875495932301184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612643.315523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932301184:0@lo:400:kworker.0 00000100:00080000:0.0:1788612643.315560:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612643.315565:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612643.315569:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932300800:0@lo:38:kworker.0 00000100:00080000:0.0:1788612643.315590:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612643.315595:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612643.315598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932301056:0@lo:38:kworker.0 00000100:00080000:0.0:1788612643.315608:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612643.315612:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612643.315615:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932301440:0@lo:38:kworker.0 00000100:00100000:0.0:1788612643.315884:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932300672 00000100:00100000:0.0:1788612643.315889:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932300672 00000100:00100000:0.0:1788612643.315921:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788612643.315929:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932300672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.315971:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612d1f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d04a0405-b620-42fe-8569-8c55f54b9b5e+19:3650:x1875495932300672:12345-0@lo:400:kworker.0 Request processed in 43us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612643.315978:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788612643.316019:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d04a0405-b620-42fe-8569-8c55f54b9b5e:3650:1875495932300672:0@lo:400:kworker.0 00000100:00080000:0.0:1788612643.316050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788612643.316224:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fccc4a80 x1875495932301568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612643.316252:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932301568:0@lo:400:kworker.0 00000100:00100000:1.0:1788612643.319657:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612643.319921:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301312 00000100:00100000:0.0:1788612643.319933:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301312 00000100:00100000:0.0:1788612643.320023:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788612643.320034:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932301312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.320143:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932301312:12345-0@lo:400:kworker.0 Request processed in 112us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612643.320151:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788612643.320419:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612643.320594:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788612643.329219:0:8253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875495932300928:12345-0@lo:38:kworker.0 Request processed in 15145us (15477us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612643.329239:0:8253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:0.0:1788612643.333073:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612643.333164:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612643.333172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932300928:0@lo:38:kworker.0 00000040:00080000:2.0:1788612643.569041:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612643.825010:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932301696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612643.825122:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612643.825394:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301696 00000100:00100000:3.0:1788612643.825405:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301696 00000100:00100000:3.0:1788612643.825517:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788612643.825528:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932301696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612643.825568:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788612643.825629:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932301696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612643.825764:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788612643.825823:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932301696:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612644.212702:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612645.231938:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:3.0:1788612645.873635:0:15207:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:3.0:1788612645.884861:0:15207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c74bf600 - data ffff9612ea748288/ffff9611c7544c00 00000020:01000000:3.0:1788612645.885797:0:15207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9612c711bea0 - data ffff9612e07cca20/ffff9612ea884800 00000001:00000004:3.0:1788612645.900225:0:15207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788612645.961835:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788612645.961849:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788612645.961873:0:15207:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9612fed70000 x1875495932296704/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788612641 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612645.962154:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788612645.981914:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788612645.981926:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788612645.981949:0:15207:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612645.981953:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788612645.983031:0:8539:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788612645.983040:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788612645.983055:0:8539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788612645.983926:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788612645.983933:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788612645.983957:0:15207:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612645.983960:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788612645.985872:0:9990:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788612645.985890:0:9990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788612645.985914:0:9990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788612645.992987:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b28 00000020:00000080:2.0:1788612645.993006:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c4843800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788612645.993583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c4843800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788612646.000241:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b3d 00000020:00000080:1.0:1788612646.000262:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612ea250800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788612646.000285:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788612646.000293:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612646.000303:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788612646.000308:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9612d1e63380) has no exports 00000004:01000000:1.0:1788612646.000553:0:15207:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788612646.000652:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f73 00000020:00000080:1.0:1788612646.000659:0:15207:0:(genops.c:885:class_export_put()) final put ffff9611c75c3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788612646.000663:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788612646.000667:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612646.000679:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788612646.000681:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9611c5a20000) has no exports 00000020:00000080:1.0:1788612646.000689:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f6c 00000020:00000080:1.0:1788612646.000694:0:15207:0:(genops.c:885:class_export_put()) final put ffff9611c78b6800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788612646.001418:0:15207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788612646.001427:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788612646.001433:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788612646.001457:0:15207:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612646.001459:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612646.001533:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612646.001544:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612646.001554:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7e31 00000020:00000080:3.0:1788612646.001848:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea250800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788612646.001860:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c75c3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788612646.001865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788612646.001871:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c78b4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788612646.001878:0:36:0:(genops.c:885:class_export_put()) final put ffff9611c78b5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788612646.001891:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788612646.001896:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612646.002163:0:15207:0:(genops.c:885:class_export_put()) final put ffff96130168a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788612646.002183:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788612646.002188:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612646.002198:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788612646.002202:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9612fb85b380) has no exports 00000020:00000080:1.0:1788612646.002210:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7e2a 00000020:00000080:1.0:1788612646.002215:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c92f6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788612646.002716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788612646.002726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c92f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788612646.003068:0:15207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788612646.003083:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788612646.003088:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788612646.003094:0:15207:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612646.003096:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612646.003180:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612646.003191:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788612646.003208:0:15207:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788612646.003217:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7ce1 00000020:00000080:1.0:1788612646.003226:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612fcfb2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788612646.011795:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c92f3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788612646.011819:0:36:0:(genops.c:885:class_export_put()) final put ffff961300765800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788612646.011824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961300765800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788612646.011835:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788612646.014824:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788612646.014848:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612646.014873:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788612646.014888:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9612fcfc19c0) has no exports 00000020:00000080:1.0:1788612646.014907:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7cda 00000020:00000080:1.0:1788612646.014918:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c71e4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788612646.022891:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788612646.022923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c71e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788612646.181923:0:15207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788612646.182057:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788612646.182064:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788612646.182086:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612646.182191:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612646.182210:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612646.182278:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c71e2000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788612646.182292:0:36:0:(genops.c:885:class_export_put()) final put ffff9612fcfb6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788612646.182296:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788612646.182310:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612646.182719:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612646.182726:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612646.182731:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c4844800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612646.182733:0:15207:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c4844800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788612646.182743:0:15207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612646.182839:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b44 00000020:00000080:1.0:1788612646.182848:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612ea254800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788612646.183006:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788612646.183012:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612646.183019:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788612646.183024:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9612ea2499c0) has no exports 00000020:00000080:1.0:1788612646.183055:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612646.183060:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788612646.183065:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b4b 00000020:00000080:1.0:1788612646.183082:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612ea255000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788612646.183530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea254800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788612646.183537:0:36:0:(genops.c:885:class_export_put()) final put ffff9612c4844000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788612646.183539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c4844000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788612646.183544:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788612646.183721:0:15207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612c7237000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788612646.183725:0:15207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612c7237000 3 00000020:01000004:1.0:1788612646.183729:0:15207:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9612c7237000 from lustre-MDT0000 00000020:00000080:1.0:1788612646.183769:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612646.183776:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788612646.183780:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c4840800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788612646.183783:0:15207:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c4840800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788612646.183793:0:15207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788612646.183846:0:15207:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788612646.183852:0:15207:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788612646.183856:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788612646.183859:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612646.183863:0:15207:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788612646.183871:0:15207:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9612c82bd000 d04a0405-b620-42fe-8569-8c55f54b9b5e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788612646.183890:0:15207:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9612d1e619c0) has exports, disconnecting them 00000020:00080000:1.0:1788612646.183908:0:15207:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9612c82bd000), last request at 1788612378 00000020:00000080:1.0:1788612646.183927:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7ae9 00000020:00010000:1.0:1788612646.183933:0:15207:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9612c82bd000: total 1 00000100:00080000:1.0:1788612646.183938:0:15207:0:(import.c:65:import_set_state_nolock()) ffff9612c82bc800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788612646.183955:0:15207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612c82bd000): rc 0 00000020:00080000:1.0:1788612646.183964:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9612d1e619c0) has no exports 00000100:00100000:1.0:1788612646.184143:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9612c9203a00:6517] 1 exiting: rc = 0 00000100:00100000:1.0:1788612646.184298:0:6518:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9612fb823000:6518] 2 exiting: rc = 0 00000100:00100000:1.0:1788612646.184408:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9612c2a19000:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1788612646.184516:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184526:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184532:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184538:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184545:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184554:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184739:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184752:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184758:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184765:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184773:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184786:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184797:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184805:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184816:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184827:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184835:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184846:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184856:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184862:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184874:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184962:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184973:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.184980:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185005:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185013:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185024:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185034:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185040:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185050:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185056:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185065:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185081:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185090:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185101:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185108:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185113:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185122:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185131:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185137:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185142:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185148:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185157:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185166:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185173:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185178:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185188:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185194:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185203:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185209:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185218:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185225:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185235:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185241:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185251:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185256:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185265:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185271:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185280:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185297:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185303:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185311:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185316:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612646.185324:0:15207:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788612646.192192:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612c2896200/0x1f8616bf0bc7be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc7bde expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192222:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896200/0x1f8616bf0bc7be5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc7bde expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192241:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc7fe3 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192250:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe924400/0x1f8616bf0bc7fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc7fe3 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192259:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612c13d1000/0x1f8616bf0bc7ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc7ff1 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192266:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d1000/0x1f8616bf0bc7ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc7ff1 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192275:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc8006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc7fff expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192283:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc8006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc7fff expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192291:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc8014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc800d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192298:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4800/0x1f8616bf0bc8014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc800d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192323:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc8022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc801b expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192332:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d0e00/0x1f8616bf0bc8022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc801b expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192341:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc8037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc8030 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192348:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc8037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc8030 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192356:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612fe924a00/0x1f8616bf0bc8061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc805a expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.192363:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe924a00/0x1f8616bf0bc8061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc805a expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193276:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612c13d0800/0x1f8616bf0bc7f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc7f03 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193296:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c13d0800/0x1f8616bf0bc7f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc7f03 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193315:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612c2896e00/0x1f8616bf0bc7bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc7bec expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193322:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896e00/0x1f8616bf0bc7bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc7bec expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193354:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612fe925e00/0x1f8616bf0bc828a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc8283 expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193365:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe925e00/0x1f8616bf0bc828a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc8283 expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193447:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8298 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc8291 expref: 3 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193456:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc8298 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc8291 expref: 3 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193465:0:15207:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9612fe925a00/0x1f8616bf0bc82a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x1f8616bf0bc829f expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.193472:0:15207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612fe925a00/0x1f8616bf0bc82a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x1f8616bf0bc829f expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788612646.193686:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9612c82bd000: total 1 00010000:00010000:2.0:1788612646.193775:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9612c82bd000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788612646.193793:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9612c82bd000, canceled 0 locks, left on hash table 0. 00000020:00000080:2.0:1788612646.193803:0:6512:0:(genops.c:885:class_export_put()) final put ffff9612c82bd000/d04a0405-b620-42fe-8569-8c55f54b9b5e 00010000:00010000:2.0:1788612646.193817:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612646.193820:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612646.193822:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788612646.201838:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea255000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788612646.201866:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c82bd000/d04a0405-b620-42fe-8569-8c55f54b9b5e for MGS 00000020:00000080:3.0:1788612646.203675:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c82bc800 for MGS 00010000:00010000:1.0:1788612646.255651:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612647.284393:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788612648.241162:0:15207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c77b2660 - data ffff9611c5c12288/ffff9611c784cc00 00000020:01000000:1.0:1788612648.241665:0:15207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9612c711b600 - data ffff9612e070d6c0/ffff9612c82a6800 00000020:00000080:1.0:1788612648.242881:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7acd 00000020:00000080:1.0:1788612648.242897:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c7235000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788612648.243065:0:15207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612c7237000 from MGS, refs=2 00000020:01000004:1.0:1788612648.243071:0:15207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612c7237000 2 00000020:01000004:1.0:1788612648.243075:0:15207:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9612c7237000 from MGS 00000020:00000080:1.0:1788612648.243113:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612648.243123:0:15207:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788612648.243127:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612d1575800/MGS 00000020:00000080:1.0:1788612648.243130:0:15207:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d1575800/MGS for MGS 00000020:01000000:1.0:1788612648.243158:0:15207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788612648.243259:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788612648.243264:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612648.243272:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788612648.243298:0:15207:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9612f7aff000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788612648.243307:0:15207:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9612c93e8000) has exports, disconnecting them 00000020:00080000:1.0:1788612648.243313:0:15207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9612f7aff000), last request at 1788612379 00000020:00000080:1.0:1788612648.243318:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7b98 00000020:00080000:1.0:1788612648.244109:0:15207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612f7aff000): rc 0 00000020:00000080:1.0:1788612648.244122:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612f7aff000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788612648.251795:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c7235000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788612648.259393:0:15207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788612648.259405:0:15207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788612648.259410:0:15207:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612648.259420:0:15207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788612648.260100:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7aff000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788612648.261095:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612648.261111:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788612648.261120:0:15207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612c7237000 1 00000020:00000080:1.0:1788612648.261142:0:15207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7abf 00000020:00000080:1.0:1788612648.261154:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612d1576000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788612648.265387:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fcc3b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788612648.265415:0:484:0:(genops.c:885:class_export_put()) final put ffff9612f7afd800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788612648.265420:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7afd800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788612648.265440:0:484:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1788612648.266141:0:15207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788612648.266152:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612648.266164:0:15207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788612648.266170:0:15207:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9612c93ecd40) has no exports 00000020:00000080:2.0:1788612648.266362:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d1576000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788612648.333656:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612648.345302:0:15207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612648.345321:0:15207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788612648.345328:0:15207:0:(genops.c:885:class_export_put()) final put ffff9612c7231800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788612648.345334:0:15207:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c7231800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788612648.345341:0:15207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788612648.346983:0:15207:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9612c7234800 00000020:02000400:0.0:1788612648.347107:0:15207:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:3.0:1788612648.432287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612648.432295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612648.432299:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612648.432310:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788612648.432316:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788612648.432324:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9612c71e0800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612648.432350:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7ad4000 x1875495932301952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612648.432379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612648.432382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612648.432385:0:36:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612648.432388:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788612648.432392:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788612648.432396:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96130066d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612648.432408:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7ad6300 x1875495932302080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612648.432416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612648.432419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612648.432421:0:36:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612648.432425:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788612648.432427:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788612648.432430:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c6491000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612648.432440:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7ad4380 x1875495932302208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612648.432472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612648.432493:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612648.432495:0:36:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612648.432499:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788612648.432501:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788612648.432505:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96130066b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612648.433070:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932301824:0@lo:400:kworker.0 00000400:00000100:1.0:1788612648.433139:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495932301824 offset 0 length 224: 4 00000100:00100000:1.0:1788612648.433221:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612648.433227:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932302592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612648.433265:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612648.433320:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932302336:0@lo:400:kworker.0 00000100:00100000:1.0:1788612648.433353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612648.434750:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612648.434774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932302464:0@lo:400:kworker.0 00000100:00100000:3.0:1788612648.435102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7ad7100 x1875495932302720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612648.435198:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612648.435209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932302848:0@lo:400:kworker.0 00000100:00100000:3.0:1788612648.435284:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612648.435335:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932301952:0@lo:38:kworker.0 00000100:00100000:3.0:1788612648.435365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612648.435384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932302080:0@lo:38:kworker.0 00000100:00100000:3.0:1788612648.435406:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612648.435424:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932302208:0@lo:38:kworker.0 00000100:00100000:3.0:1788612648.435449:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612648.435468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932302720:0@lo:38:kworker.0 00000100:00100000:0.0:1788612648.435761:0:10299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302592 00000100:00100000:0.0:1788612648.435773:0:10299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302592 00000100:00100000:1.0:1788612648.436089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612648.436131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302336 00000100:00100000:1.0:1788612648.436135:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302336 00000100:00100000:1.0:1788612648.436171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302848 00000100:00100000:1.0:1788612648.436174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302848 00000100:00100000:1.0:1788612648.436190:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302080 00000100:00100000:1.0:1788612648.436193:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302080 00000100:00100000:1.0:1788612648.436203:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302208 00000100:00100000:1.0:1788612648.436205:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302208 00000100:00100000:1.0:1788612648.436214:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788612648.436223:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932302336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612648.436282:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932302336:12345-0@lo:400:kworker.0 Request processed in 60us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612648.436289:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788612648.436306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788612648.436313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932302848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612648.436344:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932302848:12345-0@lo:400:kworker.0 Request processed in 32us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612648.436350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788612648.436361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788612648.436366:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932302080:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788612648.436387:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788612648.436417:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932302080:12345-0@lo:38:kworker.0 Request processed in 50us (1009us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612648.436434:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788612648.436445:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788612648.436449:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932302208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788612648.436460:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788612648.436596:0:10299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788612648.436671:0:10299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932302592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612648.436698:0:10299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788612648.436741:0:10299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932302592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612648.436747:0:10299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788612648.437751:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932301952 00000100:00100000:2.0:1788612648.437763:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932301952 00000100:00100000:3.0:1788612648.437845:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612648.438280:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612648.438287:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612648.438292:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932302080:0@lo:38:kworker.0 00000100:00080000:3.0:1788612648.438304:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612648.438307:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612648.438310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932302208:0@lo:38:kworker.0 00000100:00100000:3.0:1788612648.438345:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302720 00000100:00100000:3.0:1788612648.438349:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302720 00000100:00100000:3.0:1788612648.438373:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788612648.438381:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932302720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788612648.438401:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788612648.438456:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932302720:12345-0@lo:38:kworker.0 Request processed in 74us (612us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612648.438499:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788612648.438699:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932302208:12345-0@lo:38:kworker.0 Request processed in 2245us (3246us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612648.438707:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1788612648.438733:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612648.438738:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612648.438751:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302464 00000100:00100000:1.0:1788612648.438755:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302464 00000100:00100000:2.0:1788612648.438846:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788612648.438852:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932301952:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788612648.439023:0:6528:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788612648.439076:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932301952:12345-0@lo:38:kworker.0 Request processed in 223us (3710us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612648.439083:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788612648.439174:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788612648.439183:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932302464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612648.439227:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932302464:12345-0@lo:400:kworker.0 Request processed in 47us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612648.439234:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1788612648.439247:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788612648.439275:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9611c7ad6a00 x1875495932302848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612648.439290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932302848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612648.439335:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932302592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612648.439360:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932302464:0@lo:400:kworker.0 00010000:00080000:1.0:1788612648.439374:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9611c7ad5f80 x1875495932302336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612648.439398:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932302336:0@lo:400:kworker.0 00000100:00080000:3.0:1788612648.440261:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612648.440269:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612648.440273:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932301952:0@lo:38:kworker.0 00000100:00080000:3.0:1788612648.440284:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612648.440288:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788612648.440291:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932302720:0@lo:38:kworker.0 00000100:00100000:1.0:1788612648.943988:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932302976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612648.944122:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612648.944447:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932302976 00000100:00100000:0.0:1788612648.944459:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932302976 00000100:00100000:0.0:1788612648.944564:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788612648.944575:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932302976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612648.944614:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788612648.944674:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932302976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612648.944682:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788612648.944781:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932302976:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612649.396769:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612650.415613:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612651.452385:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612652.467254:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788612652.524042:0:15410:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788612652.547124:0:15410:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788612652.547179:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.547194:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.547215:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.547223:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.547250:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788612652.547256:0:15410:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788612652.547279:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612652.547283:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788612652.547289:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788612652.547294:0:15410:0:(import.c:65:import_set_state_nolock()) ffff96130066d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788612652.547299:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612652.547300:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788612652.547303:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788612652.548189:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548202:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548208:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548215:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548229:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612652.548244:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548251:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548258:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548264:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548272:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788612652.548278:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548284:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548290:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548296:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548303:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788612652.548307:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548315:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548328:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548334:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612652.548341:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1788612652.548344:0:15410:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788612652.548367:0:15410:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788612652.548371:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788612652.548375:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612652.548381:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788612652.548389:0:15410:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9611c75c0000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612652.548395:0:15410:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff961300668800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612652.548400:0:15410:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9612fcfc3380) has exports, disconnecting them 00000020:00080000:0.0:1788612652.548404:0:15410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9611c75c0000), last request at 1788612648 00000020:00000080:0.0:1788612652.548412:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7ecb 00000100:00080000:0.0:1788612652.548435:0:15410:0:(import.c:65:import_set_state_nolock()) ffff9611c75c3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788612652.548511:0:15410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c75c0000): rc 0 00000020:00000080:0.0:1788612652.548514:0:15410:0:(genops.c:885:class_export_put()) final put ffff9611c75c0000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788612652.548519:0:15410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff961300668800), last request at 1788612648 00000020:00000080:0.0:1788612652.548522:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7da5 00000100:00080000:0.0:1788612652.548528:0:15410:0:(import.c:65:import_set_state_nolock()) ffff96130066b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788612652.548533:0:15410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961300668800): rc 0 00000020:00000080:0.0:1788612652.548535:0:15410:0:(genops.c:885:class_export_put()) final put ffff961300668800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788612652.548540:0:15410:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa9b940c87ae0 00000100:00080000:0.0:1788612652.548556:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612652.548570:0:15410:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9612fed71f80 x1875495932297088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788612647 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612652.548583:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788612652.549402:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788612652.549408:0:15410:0:(import.c:65:import_set_state_nolock()) ffff9612c71e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788612652.549571:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788612652.549574:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788612652.549586:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788612652.549648:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788612652.549672:0:15410:0:(import.c:65:import_set_state_nolock()) ffff9612c92f1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788612652.549686:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788612652.549688:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788612652.549695:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788612652.549750:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788612652.549757:0:15410:0:(import.c:65:import_set_state_nolock()) ffff96130168c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788612652.549778:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9612fcfc3380) has no exports 00010000:00010000:3.0:1788612652.549866:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788612652.549875:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.549885:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612652.549889:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.549899:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612652.549906:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612652.549912:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612652.549915:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788612652.549918:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788612652.549953:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.549961:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612652.549986:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.549994:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3c00/0x1f8616bf0bc801b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8022 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550005:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788612652.550009:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550015:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612652.550018:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550035:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612652.550042:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612652.550046:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612652.550048:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788612652.550050:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788612652.550064:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550071:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612652.550082:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550095:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc8030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc8037 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550105:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788612652.550109:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550114:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896400 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612652.550117:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550124:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612652.550130:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612652.550136:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612652.550138:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788612652.550140:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788612652.550152:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550158:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612652.550164:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550170:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896400/0x1f8616bf0bc7f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7f0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550193:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612652.550197:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550203:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612652.550205:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550212:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612652.550219:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612652.550224:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788612652.550225:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788612652.550228:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788612652.550240:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550246:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612652.550252:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550258:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe925600/0x1f8616bf0bc829f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc82a6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550266:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612652.550269:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550279:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612652.550282:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550288:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612652.550294:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612652.550299:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612652.550301:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788612652.550303:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788612652.550317:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550322:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612652.550327:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550333:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc7bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc7bf3 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612652.550345:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612652.550346:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612652.550348:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612652.550355:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612652.550369:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932303104:0@lo:9:umount.0 00000100:00100000:3.0:1788612652.550434:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550524:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932303232:0@lo:9:umount.0 00000100:00100000:3.0:1788612652.550549:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932303744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.550659:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550683:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788612652.550688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932303360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.550706:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550720:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932303872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.550735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550759:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932303616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.550779:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550795:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612652.550800:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932303488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.550817:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612652.550842:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303104 00000100:00100000:3.0:1788612652.550848:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303104 00000100:00100000:3.0:1788612652.550894:0:8543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303232 00000100:00100000:3.0:1788612652.550898:0:8543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303232 00000100:00100000:3.0:1788612652.550920:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788612652.550929:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875495932303104:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788612652.550951:0:8543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7df2 00000100:00080000:3.0:1788612652.550958:0:8543:0:(import.c:65:import_set_state_nolock()) ffff961300762000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612652.550990:0:8543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788612652.551125:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875495932303104:12345-0@lo:9:umount.0 Request processed in 196us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612652.551134:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788612652.551160:0:8543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788612652.551174:0:8543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875495932303232:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788612652.551185:0:8543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f34 00000100:00080000:3.0:1788612652.551190:0:8543:0:(import.c:65:import_set_state_nolock()) ffff96130066a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612652.551209:0:8543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788612652.551282:0:8543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875495932303232:12345-0@lo:9:umount.0 Request processed in 109us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612652.551288:0:8543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788612652.551310:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303744 00000100:00100000:3.0:1788612652.551314:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303744 00000100:00100000:3.0:1788612652.551328:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303360 00000100:00100000:3.0:1788612652.551330:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303360 00000100:00100000:3.0:1788612652.551336:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303872 00000100:00100000:3.0:1788612652.551338:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303872 00000100:00100000:3.0:1788612652.551343:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303616 00000100:00100000:3.0:1788612652.551346:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303616 00000100:00100000:3.0:1788612652.551351:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932303488 00000100:00100000:3.0:1788612652.551353:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932303488 00000100:00100000:3.0:1788612652.551362:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612652.551366:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875495932303744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788612652.551372:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612652 with bad export cookie 141970504490449641 00000020:00000080:2.0:1788612652.553175:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c75c0000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788612652.553225:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff961300668800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788612652.553248:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c75c3000 for lustre-MDT0001 00000020:00000080:2.0:1788612652.553253:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130066b000 for lustre-MDT0001 00000100:00100000:1.0:1788612652.553519:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932297088:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788612652.553593:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612652.553597:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612652.553618:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612652.553625:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875495932303360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788612652.553631:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612652 with bad export cookie 141970504490449641 00000100:00100000:1.0:1788612652.553722:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875495932303360:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (3014us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612652.553729:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612652.553751:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612652.553756:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875495932303872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788612652.553760:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612652 with bad export cookie 141970504490449641 00000100:00100000:1.0:1788612652.553786:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875495932303872:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (3049us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612652.553792:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612652.553804:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612652.553808:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875495932303616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788612652.553812:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612652 with bad export cookie 141970504490449641 00000100:00100000:1.0:1788612652.553842:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875495932303616:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (3062us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612652.553864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612652.553877:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612652.553882:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875495932303488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788612652.553886:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612652 with bad export cookie 141970504490449641 00000100:00100000:1.0:1788612652.553917:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875495932303488:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (3099us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612652.553923:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788612652.553968:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612652.553982:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612652.554012:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c92f1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788612652.554034:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788612652.554036:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612652.554040:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932303104:0@lo:9:umount.0 00000100:00080000:1.0:1788612652.554054:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130168c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788612652.554062:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788612652.554063:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612652.554066:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932303232:0@lo:9:umount.0 00000100:00080000:1.0:1788612652.554105:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788612652.554109:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9612c82b9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788612652.554112:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788612652.554171:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788612652.568171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875495932303744:12345-0@lo:103:ldlm_bl.0 Request processed in 16798us (17506us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788612652.568185:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788612652.597281:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788612652.597287:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788612652.597297:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c7ad4700 x1875495932301824/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788612664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612652.597312:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c7ad6300 x1875495932303744/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612668 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612652.597346:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c7ad7100 x1875495932303360/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612668 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612652.597354:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c7ad4a80 x1875495932303872/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612668 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612652.597362:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c7ad4380 x1875495932303616/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612668 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612652.597370:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c7ad4000 x1875495932303488/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612668 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612652.599694:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9612c82b9000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788612652.601916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932303872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.601930:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932303744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612652.601962:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d04a0405-b620-42fe-8569-8c55f54b9b5e:3648:1875495932303360:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788612652.602644:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788612652.602649:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788612652.602650:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788612652.602655:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9612c82b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612652.602661:0:3651:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:1.0:1788612652.602669:0:3651:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9612c82b9000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612652.607195:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79aad80 x1875495932304000/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612652.607259:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d04a0405-b620-42fe-8569-8c55f54b9b5e:3647:1875495932304000:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788612652.607313:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495932304000 offset 0 length 520: 4 00000100:00100000:0.0:1788612652.607457:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932303616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612652.607465:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932301824:0@lo:400:kworker.0 00000100:00100000:0.0:1788612652.607521:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d04a0405-b620-42fe-8569-8c55f54b9b5e:3651:1875495932303488:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788612652.610301:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9612fcfc3380) has no exports 00000020:01000000:0.0:1788612652.675314:0:15410:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c74bf900 - data ffff9611c5c260d8/ffff9611c7547000 00000020:01000000:0.0:1788612652.675472:0:15410:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9612f7bb4960 - data ffff9612ea5f06c0/ffff9613007bac00 00000001:00000004:0.0:1788612652.689394:0:15410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788612652.749316:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612652.749339:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788612652.749348:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788612652.755755:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788612652.755763:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788612652.755782:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788612652.755784:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788612652.756579:0:8532:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788612652.756596:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788612652.756605:0:8532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788612652.757141:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788612652.757145:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788612652.757161:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788612652.757163:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788612652.758054:0:9986:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788612652.758058:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788612652.758067:0:9986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788612652.759393:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c0f 00000020:00000080:0.0:1788612652.759404:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612fcfb3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788612652.761164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788612652.763055:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c24 00000020:00000080:0.0:1788612652.763067:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612ea252800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788612652.763085:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788612652.763091:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612652.763098:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788612652.763103:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9612fcfc4d40) has no exports 00000004:01000000:0.0:1788612652.763255:0:15410:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788612652.763263:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f2d 00000020:00000080:0.0:1788612652.763266:0:15410:0:(genops.c:885:class_export_put()) final put ffff9611c75c4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788612652.763270:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788612652.763273:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612652.763278:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788612652.763280:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9611c64bcd40) has no exports 00000020:00000080:0.0:1788612652.763286:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7f26 00000020:00000080:0.0:1788612652.763289:0:15410:0:(genops.c:885:class_export_put()) final put ffff96130168b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788612652.763647:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea252800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788612652.763656:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c75c4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788612652.763660:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788612652.763826:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788612652.763830:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788612652.763835:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788612652.763840:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788612652.763843:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612652.763920:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612652.763928:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788612652.763933:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7deb 00000020:00000080:0.0:1788612652.763938:0:15410:0:(genops.c:885:class_export_put()) final put ffff961300764800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612652.769291:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130168c000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788612652.769308:0:8:0:(genops.c:885:class_export_put()) final put ffff9611c75c1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612652.769311:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c75c1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788612652.769319:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612652.774322:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961300764800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788612652.780650:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788612652.780817:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612652.780831:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788612652.780836:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9612ea24b380) has no exports 00000020:00000080:1.0:1788612652.780845:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7de4 00000020:00000080:1.0:1788612652.780854:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612c92f2800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788612652.781267:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788612652.781272:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788612652.781276:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788612652.781280:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612652.781283:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612652.781314:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612652.781329:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788612652.781341:0:15410:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788612652.781347:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c47 00000020:00000080:1.0:1788612652.781351:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612fcfb3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788612652.781355:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788612652.781357:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612652.781360:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788612652.781363:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9612ea24cd40) has no exports 00000020:00000080:1.0:1788612652.781366:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c40 00000020:00000080:1.0:1788612652.781368:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612c71e3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788612652.784371:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c92f2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788612652.784390:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c92f1800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788612652.784400:0:8:0:(genops.c:885:class_export_put()) final put ffff9612c92f0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612652.784402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c92f0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788612652.784407:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612652.784521:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788612652.784528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c71e3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788612652.785540:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788612652.785546:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612652.785550:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788612652.785557:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612652.785605:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612652.785615:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788612652.785646:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612652.785648:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788612652.785652:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612fcfb5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788612652.785656:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788612652.785666:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788612652.785806:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c2b 00000020:00000080:0.0:1788612652.785812:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612ea256000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788612652.785817:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788612652.785821:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612652.785825:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788612652.785828:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9612fcfc0000) has no exports 00000020:00000080:0.0:1788612652.785845:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612652.785848:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788612652.785852:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c32 00000020:00000080:0.0:1788612652.785855:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612ea251000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788612652.785863:0:15410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fccf8000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788612652.785866:0:15410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fccf8000 2 00000020:01000004:0.0:1788612652.785868:0:15410:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9612fccf8000 from lustre-MDT0001 00000020:00000080:0.0:1788612652.785885:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612652.785889:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788612652.785891:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612fcfb0800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788612652.785905:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcfb0800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788612652.785911:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788612652.785940:0:15410:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788612652.785944:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788612652.785947:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612652.785950:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612652.785957:0:15410:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff96130066c800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612652.785962:0:15410:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9612fb8599c0) has exports, disconnecting them 00000020:00080000:0.0:1788612652.785966:0:15410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff96130066c800), last request at 1788612401 00000020:00000080:0.0:1788612652.785969:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7c86 00000020:00080000:0.0:1788612652.785980:0:15410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96130066c800): rc 0 00000020:00000080:0.0:1788612652.785983:0:15410:0:(genops.c:885:class_export_put()) final put ffff96130066c800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788612652.786438:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c71e0800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788612652.786446:0:8:0:(genops.c:885:class_export_put()) final put ffff9612ea255800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612652.786448:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea255800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788612652.786452:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612652.786555:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea256000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788612652.786559:0:8:0:(genops.c:885:class_export_put()) final put ffff9612ea250000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788612652.786567:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea250000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788612652.786571:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788612652.786730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ea251000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788612652.786735:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96130066c800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788612652.790171:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788612652.790179:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788612652.790184:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788612652.790194:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612652.790238:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130066d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788612652.790408:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612652.790416:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788612652.790421:0:15410:0:(genops.c:885:class_export_put()) final put ffff961300669800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788612652.790424:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff961300669800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788612652.790429:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788612652.790522:0:15410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fccf8000 1 00000020:00000080:3.0:1788612652.790528:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7bc2 00000020:00000080:3.0:1788612652.790533:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612fcdcf800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788612652.790540:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788612652.790547:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcdcf800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788612652.790556:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612652.790560:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788612652.790564:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9612c93e99c0) has no exports 00000020:00000080:3.0:1788612653.077301:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612653.077317:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788612653.077322:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612fccfb800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788612653.077326:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fccfb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788612653.077338:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788612653.077460:0:15410:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9612fccfb000 00000020:01000000:3.0:1788612653.077508:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788612653.077513:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612653.077526:0:15410:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788612653.077530:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9612fb858000) has no exports 00000100:00100000:3.0:1788612653.077613:0:6525:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9612c714a200:6525] 2 exiting: rc = 0 00000100:00100000:3.0:1788612653.077722:0:8253:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff961300758800:8253] 3 exiting: rc = 0 00000100:00100000:1.0:1788612653.077932:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9612c9265c00:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1788612653.078029:0:12327:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9611c793ec00:12327] 4 exiting: rc = 0 00000100:00100000:0.0:1788612653.078513:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9612c9265a00:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1788612653.083761:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083770:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083776:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083781:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083786:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083791:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083796:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083802:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083807:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083813:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083819:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083825:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083830:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083835:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083841:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083847:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083854:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083859:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083865:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083870:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083876:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083881:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083887:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083892:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083898:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083903:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083909:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083914:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083919:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083924:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083928:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083951:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083957:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083963:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083969:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083975:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083979:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083984:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083989:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.083994:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084000:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084005:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084010:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084016:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084032:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084038:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084044:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084049:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084055:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084060:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084065:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084070:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084075:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084081:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084086:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084091:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084096:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084102:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084107:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084112:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084116:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084122:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084127:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.084133:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612653.095133:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9612c71f0600:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1788612653.095244:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9612c71f0c00:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788612653.096193:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096203:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096209:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096216:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096223:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096242:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096248:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096254:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096260:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096266:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096272:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096278:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096286:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096291:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096296:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096301:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096307:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096312:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096317:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096323:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096329:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096334:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096339:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096345:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096350:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096355:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096360:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096366:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096371:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096384:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096389:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096394:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096399:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096405:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096410:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096415:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096420:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096424:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096429:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096434:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096445:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096450:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096455:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096460:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096465:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096500:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096506:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096511:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096516:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096522:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096527:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096533:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096539:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096544:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096549:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096554:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096559:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096563:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096568:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096573:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096577:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096582:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096587:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.096592:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612653.097097:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9612c9264c00:6528] 0 exiting: rc = 1 00000100:00100000:2.0:1788612653.097211:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9612c9265800:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1788612653.097267:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097277:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097284:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097291:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097298:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097304:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097310:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097315:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097321:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097328:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097342:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097349:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097355:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097362:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097368:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097374:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097380:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097402:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097411:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097416:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097422:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097427:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097433:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097438:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097444:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097449:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097455:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097460:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097466:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097503:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097511:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097517:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097523:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097529:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097536:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097542:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097548:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097554:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097559:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097565:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097570:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097591:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097599:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097605:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097611:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097624:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097628:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097633:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097639:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097643:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097649:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097654:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097660:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097677:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097683:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097688:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097693:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097698:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097703:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097708:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097712:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097718:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097723:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.097735:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.107263:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9612c71f1600:6530] 0 exiting: rc = 1 00000100:00100000:3.0:1788612653.107854:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9612c71f1e00:6531] 1 exiting: rc = 0 00000100:00100000:2.0:1788612653.108014:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108032:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108038:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108043:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108049:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108055:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108061:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108067:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108072:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108077:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108083:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108088:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108093:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108098:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108103:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108108:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108128:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108133:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108138:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108143:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108148:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108153:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108158:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108162:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108167:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108172:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108178:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108183:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108188:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108193:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108198:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108202:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108207:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108212:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108219:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108226:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108231:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108236:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108240:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108245:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108250:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108254:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108259:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108263:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108267:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108272:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108276:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108281:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108285:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108290:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108294:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108307:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108312:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108317:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108321:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108326:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108330:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108335:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108340:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108345:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108350:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108355:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108360:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.108365:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612653.109743:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9612fb8eea00:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1788612653.110008:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9612ec09c600:6532] 0 exiting: rc = 1 00000100:00100000:3.0:1788612653.110109:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110124:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110129:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110134:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110139:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110145:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110151:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110156:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110161:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110166:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110172:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110178:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110183:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110189:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110195:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110201:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110206:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110211:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110216:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110222:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110227:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110233:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110238:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110243:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110248:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110254:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110259:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110265:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110270:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110275:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110280:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110285:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110291:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110297:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110303:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110308:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110323:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110327:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110332:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110337:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110342:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110347:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110352:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110358:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110362:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110367:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110372:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110793:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110802:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110807:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110812:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110816:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110821:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110826:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110831:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110836:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110841:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110846:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110851:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110855:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110860:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110865:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110870:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612653.110875:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111278:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9612fb8ef000:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1788612653.111626:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9612fb8eec00:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1788612653.111714:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111720:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111725:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111730:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111734:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111739:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111745:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111751:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111756:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111762:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111767:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111772:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111777:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111783:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111789:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111794:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111799:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111804:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111819:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111824:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111828:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111833:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111838:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111843:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111848:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111852:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111856:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111860:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111864:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111868:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111872:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111876:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111880:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111884:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111888:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111893:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111897:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111902:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111907:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111911:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111916:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111921:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111926:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111931:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111937:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111942:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111946:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111951:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111969:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111975:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111980:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111984:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.111989:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112002:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112007:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112012:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112017:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112032:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112037:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112043:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112048:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112053:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112058:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112063:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.112521:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9612c9205e00:6537] 1 exiting: rc = 0 00000100:00100000:1.0:1788612653.112703:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9612fb8ee000:6538] 2 exiting: rc = 0 00000100:00100000:3.0:1788612653.113417:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9612fb8ef200:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1788612653.113989:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.113996:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114001:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114006:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114012:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114018:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114036:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114041:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114046:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114051:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114057:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114062:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114068:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114092:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114099:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114105:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114111:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114116:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114122:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114127:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114133:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114138:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114157:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114162:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114167:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114173:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114179:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114185:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114190:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114195:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114201:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114206:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114211:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114217:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114222:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114228:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114233:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114254:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114261:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114266:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114272:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114277:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114281:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114286:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114292:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114297:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114303:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114308:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114313:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114318:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114324:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114329:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114335:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114341:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114347:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114352:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114357:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114371:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114387:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114394:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114399:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114404:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114410:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612653.114425:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788612653.118930:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612653.118942:0:15410:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788612653.118948:0:15410:0:(genops.c:885:class_export_put()) final put ffff9612c909f800/MDS_uuid 00000020:00000080:1.0:1788612653.118952:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c909f800/MDS_uuid for MDS 00000020:01000000:1.0:1788612653.118957:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788612653.119106:0:15410:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788612653.487629:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612653.553761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612653.553769:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612653.553772:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612653.553787:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612653.553792:0:8:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612653.553799:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1788612653.553803:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788612653.553810:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c6491000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612653.553851:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed59f80 x1875495932304128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612653.553882:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612653.553886:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612653.553887:0:8:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612653.553891:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1788612653.553893:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788612653.553896:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96130066b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612653.553905:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed58e00 x1875495932304384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612653.554060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932304256:0@lo:400:kworker.0 00000400:00000100:1.0:1788612653.554112:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304256 offset 0 length 224: 4 00000100:00100000:1.0:1788612653.554168:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612653.554174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932304512:0@lo:400:kworker.0 00000400:00000100:1.0:1788612653.554192:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304512 offset 0 length 224: 4 00000100:00100000:0.0:1788612653.557980:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932304128:0@lo:38:kworker.0 00000400:00000100:0.0:1788612653.558076:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304128 offset 0 length 520: 4 00000100:00100000:0.0:1788612653.558119:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932304384:0@lo:38:kworker.0 00000400:00000100:0.0:1788612653.558138:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304384 offset 0 length 520: 4 00010000:00010000:1.0:1788612654.511675:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612655.535624:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612656.561050:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788612657.560009:0:15611:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788612657.576638:0:15611:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788612657.576690:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612657.576704:0:15611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612657.576711:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612657.576718:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612657.576746:0:15611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788612657.576752:0:15611:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788612657.576776:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788612657.576788:0:15611:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed59f80 x1875495932304128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612657.576810:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788612657.576816:0:15611:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788612657.576822:0:15611:0:(import.c:65:import_set_state_nolock()) ffff9611c6491000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788612657.576827:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788612657.576830:0:15611:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed59f80 x1875495932304128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612678 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612657.576837:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788612657.576840:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 28s for inflight to error out 00000100:00100000:3.0:1788612657.576902:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932304128:0@lo:38:kworker.0 00000100:00080000:3.0:1788612657.577726:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788612657.577735:0:15611:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed5b100 x1875495932304256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612669 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612657.577752:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788612657.577757:0:15611:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788612657.577775:0:15611:0:(import.c:65:import_set_state_nolock()) ffff9611c6490000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788612657.577802:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932304640:0@lo:39:umount.0 00000400:00000100:3.0:1788612657.577847:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304640 offset 0 length 224: 4 00010000:00010000:0.0:1788612657.585090:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612657.585104:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612657.585116:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612657.585121:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612657.585151:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612657.585159:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612657.585164:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612657.585167:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788612657.585170:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788612657.585185:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612657.585189:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612657.585196:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe925200/0x1f8616bf0bc7fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8006 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612657.585207:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612657.585209:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612657.585211:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612657.585257:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932304256:0@lo:400:kworker.0 00000100:00080000:0.0:1788612657.589811:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612657.589821:0:484:0:(pinger.c:247:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612657.589825:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612657.589828:0:484:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612657.590597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612657.590622:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932304768:0@lo:400:kworker.0 00000400:00000100:2.0:1788612657.590677:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304768 offset 0 length 224: 4 00010000:00010000:3.0:1788612657.591703:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.608088:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612658.608305:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612658.608311:0:484:0:(pinger.c:247:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612658.608329:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612658.608333:0:484:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612658.608416:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932304896:0@lo:400:kworker.0 00000400:00000100:2.0:1788612658.608468:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932304896 offset 0 length 224: 4 00000001:00100000:3.0:1788612658.674092:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612658.674106:0:8434:0:(genops.c:885:class_export_put()) final put ffff961300766800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788612658.674223:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff961300766800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788612658.674466:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961300762000 for lustre-OST0000 00000001:00100000:0.0:1788612658.680670:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788612658.680679:0:9518:0:(genops.c:885:class_export_put()) final put ffff96130066e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788612658.680766:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff96130066e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788612658.680863:0:484:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130066a800 for lustre-OST0001 00010000:00010000:3.0:1788612659.635470:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612660.658190:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612661.680944:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612662.703737:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612652/real 1788612652] req@ffff9611c79aad80 x1875495932304000/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788612662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612662.703790:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9611c79aad80 x1875495932304000/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788612662 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788612662.703813:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c82b9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612662.703839:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788612662.703845:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d04a0405-b620-42fe-8569-8c55f54b9b5e:3647:1875495932304000:0@lo:250:ptlrpcd_00_03.0 00010000:00010000:2.0:1788612662.703850:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612662.705940:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612662.705949:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788612662.705953:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612c82b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612662.705972:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 466 00000100:00080000:1.0:1788612662.705978:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788612662.705986:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9612c82b9000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612662.706019:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80eed80 x1875495932305024/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612662.706050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612662.706068:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612662.706212:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932305152:0@lo:400:kworker.0 00000400:00000100:0.0:1788612662.706272:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932305152 offset 0 length 224: 4 00000100:00100000:3.0:1788612662.709241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d04a0405-b620-42fe-8569-8c55f54b9b5e:3647:1875495932305024:0@lo:250:kworker.0 00000400:00000100:3.0:1788612662.709398:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495932305024 offset 0 length 520: 4 00010000:00010000:3.0:1788612663.727689:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612664.753028:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612665.775682:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612666.800373:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612667.823593:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612657/real 1788612657] req@ffff9612fed59f80 x1875495932304640/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612667 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612667.823629:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fed59f80 x1875495932304640/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612667 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612667.823648:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c6490000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788612667.823666:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932304640:0@lo:39:umount.0 00000100:00080000:3.0:1788612667.823757:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788612667.823766:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788612667.823775:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788612667.824904:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.824930:0:15611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.824939:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.824946:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.825123:0:15611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612667.825135:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.825143:0:15611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.825150:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612667.825156:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.832967:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612667.832986:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833002:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612667.833007:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833020:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612667.833027:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612667.833061:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612667.833064:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788612667.833083:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612667.833087:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833094:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2a00/0x1f8616bf0bc800d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8014 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833117:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612667.833120:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833126:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe925000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612667.833130:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833137:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612667.833143:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612667.833148:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788612667.833150:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788612667.833154:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612667.833157:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612667.833177:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612667.833178:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612667.833181:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612667.836977:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612667.843629:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612667.843637:0:15611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788612667.843656:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe925000/0x1f8616bf0bc8291 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8298 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612667.843684:0:15611:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788612667.843697:0:15611:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788612667.843701:0:15611:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788612667.843749:0:15611:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788612667.843755:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788612667.843768:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612667.843776:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788612667.843782:0:15611:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9612fb85cd40) has no exports 00000020:00080000:3.0:1788612667.843814:0:15611:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9612fb85cd40) has no exports 00000020:01000000:3.0:1788612667.850432:0:15611:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c77b2780 - data ffff9611c5c12870/ffff9611c78ab400 00000020:01000000:3.0:1788612667.850694:0:15611:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c5bcda80 - data ffff9612ea4276c0/ffff9611c5a3cc00 00100000:10000000:3.0:1788612667.866707:0:15611:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000100:00080000:0.0:1788612667.889679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612667.889688:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612667.889692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612667.889695:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788612667.889858:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932305280:0@lo:400:kworker.0 00000400:00000100:3.0:1788612667.889949:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932305280 offset 0 length 224: 4 00000020:00000080:1.0:1788612667.891609:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7d5f 00000020:00000080:1.0:1788612667.891621:0:15611:0:(genops.c:885:class_export_put()) final put ffff9612f7af9000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788612667.891642:0:15611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fcfb4000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788612667.891646:0:15611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fcfb4000 2 00000020:01000004:1.0:1788612667.891649:0:15611:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9612fcfb4000 from lustre-OST0000 00000020:00000080:0.0:1788612667.891653:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7af9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788612667.891675:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612667.891684:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788612667.891687:0:15611:0:(genops.c:885:class_export_put()) final put ffff9612f7afe000/lustre-OST0000_UUID 00000020:00000080:1.0:1788612667.891689:0:15611:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7afe000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788612667.891695:0:15611:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788612667.893592:0:15611:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788612667.893601:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788612667.893605:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612667.893612:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788612667.893619:0:15611:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9611c6497000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788612667.893626:0:15611:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9611c64bb380) has exports, disconnecting them 00000020:00080000:1.0:1788612667.893632:0:15611:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9611c6497000), last request at 1788612422 00000020:00000080:1.0:1788612667.893637:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7d89 00000020:00080000:1.0:1788612667.893651:0:15611:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c6497000): rc 0 00000020:00000080:1.0:1788612667.893656:0:15611:0:(genops.c:885:class_export_put()) final put ffff9611c6497000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788612667.893729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6497000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788612667.898823:0:15611:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788612667.898831:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612667.898835:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788612667.898841:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612667.899000:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612667.899009:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788612667.899015:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788612667.899019:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612667.899025:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612667.899032:0:15611:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9611c6493000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612667.899039:0:15611:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9611c64b8000) has exports, disconnecting them 00000020:00080000:0.0:1788612667.899044:0:15611:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9611c6493000), last request at 1788612422 00000020:00000080:0.0:1788612667.899048:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7d9e 00000020:00080000:0.0:1788612667.899061:0:15611:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c6493000): rc 0 00000020:00000080:0.0:1788612667.899066:0:15611:0:(genops.c:885:class_export_put()) final put ffff9611c6493000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788612667.900062:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c6491000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788612667.900070:0:8:0:(genops.c:885:class_export_put()) final put ffff9611c6494000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788612667.900072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6494000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788612667.900082:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788612667.900141:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6493000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788612667.960746:0:15611:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788612667.960754:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788612667.960758:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788612667.960766:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612667.961039:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c6490000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788612667.961335:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612667.961688:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788612667.961693:0:15611:0:(genops.c:885:class_export_put()) final put ffff9611c6492000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788612667.961701:0:15611:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6492000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788612667.961708:0:15611:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788612667.961775:0:15611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fcfb4000 1 00000020:00000080:0.0:1788612667.961781:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7d27 00000020:00000080:0.0:1788612667.961787:0:15611:0:(genops.c:885:class_export_put()) final put ffff9612fe9f6000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788612667.961799:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788612667.961803:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612667.961808:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788612667.961811:0:15611:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9612fe9e8000) has no exports 00000020:00000080:3.0:1788612667.962030:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fe9f6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788612668.065403:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612668.065415:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788612668.065421:0:15611:0:(genops.c:885:class_export_put()) final put ffff9612fcdc8000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788612668.065425:0:15611:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcdc8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788612668.065435:0:15611:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788612668.065577:0:15611:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9612fe89e000 00000020:02000400:2.0:1788612668.065620:0:15611:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788612668.849356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788612669.871611:0:3650:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612653/real 1788612653] req@ffff9612fed59880 x1875495932304512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612669 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788612669.878965:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612669.915749:0:3650:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9612fed59880 x1875495932304512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612669 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612669.915763:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9611c75c7000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788612669.915767:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788612669.944039:0:3650:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1788612669.944125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612669.944131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612669.944133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612669.944137:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612669.944139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612669.944142:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788612669.944146:0:36:0:(import.c:65:import_set_state_nolock()) ffff9611c75c7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612669.944153:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 255 00000100:00080000:3.0:1788612669.944162:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9611c75c7000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612669.944197:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed58a80 x1875495932305408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612669.944252:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932304512:0@lo:400:kworker.0 00000100:00100000:0.0:1788612669.955145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932305408:0@lo:38:kworker.0 00000400:00000100:0.0:1788612669.955240:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932305408 offset 0 length 520: 4 00010000:00010000:2.0:1788612670.897224:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612671.924418:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788612672.435794:0:15814:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788612672.458144:0:15814:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788612672.458230:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.458245:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.458251:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.458258:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.458279:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788612672.458285:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788612672.458308:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612672.458319:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed58e00 x1875495932304384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.458335:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612672.458353:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612672.458359:0:15814:0:(import.c:65:import_set_state_nolock()) ffff96130066b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788612672.458364:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612672.458369:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed58e00 x1875495932304384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612678 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.458376:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612672.458379:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788612672.458841:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932304384:0@lo:38:kworker.0 00010000:00010000:3.0:1788612672.458939:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612672.458947:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612672.458962:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612672.458966:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612672.458974:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612672.458981:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612672.458986:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612672.458989:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788612672.458991:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788612672.459004:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:3.0:1788612672.459007:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612672.459013:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2000/0x1f8616bf0bc7fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc7fea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612672.459025:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612672.459026:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612672.459028:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788612672.462834:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788612672.462851:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c79aa680 x1875495932304768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612673 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.462943:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c79a9f80 x1875495932304896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612674 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.462953:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c80ed880 x1875495932305152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.463009:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c79aaa00 x1875495932305280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612683 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.463027:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed58a80 x1875495932305408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.463035:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612672.463041:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788612672.463048:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9611c75c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788612672.463054:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788612672.463057:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c79aa680 x1875495932304768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612673 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612672.463202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932304768:0@lo:400:kworker.0 00000100:00100000:2.0:1788612672.463305:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c79a9f80 x1875495932304896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612674 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.463314:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c80ed880 x1875495932305152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612678 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612672.463363:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932305152:0@lo:400:kworker.0 00000100:00100000:2.0:1788612672.463403:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c79aaa00 x1875495932305280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612683 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.463410:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fed58a80 x1875495932305408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612679 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612672.463416:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788612672.463505:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932304896:0@lo:400:kworker.0 00000100:00100000:0.0:1788612672.463825:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932305408:0@lo:38:kworker.0 00000100:00100000:0.0:1788612672.463868:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932305280:0@lo:400:kworker.0 00000100:00100000:2.0:1788612672.463992:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788612672.465263:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465281:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465288:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465296:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465372:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612672.465381:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465389:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465395:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612672.465401:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465440:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612672.465447:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465453:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612fe924200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612672.465457:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465465:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612672.465473:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612672.465507:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612672.465510:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788612672.465522:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612672.465525:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612fe924200/0x1f8616bf0bc7ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc7ff8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465546:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612672.465549:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465555:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612672.465564:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465571:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612672.465577:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612672.465581:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788612672.465583:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788612672.465588:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612672.465591:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.465598:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612672.465599:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612672.465601:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612672.465743:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612672.465748:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc8283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc828a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612672.465763:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788612672.465768:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788612672.465770:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788612672.465795:0:15814:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788612672.465799:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788612672.465804:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612672.465809:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788612672.465813:0:15814:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9611c69d0000) has no exports 00000020:00080000:2.0:1788612672.465836:0:15814:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9611c69d0000) has no exports 00000020:01000000:2.0:1788612672.467532:0:15814:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c74bf180 - data ffff9612ea5db0d8/ffff9611c7546800 00000020:01000000:2.0:1788612672.467700:0:15814:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c77b29c0 - data ffff9611c5c461b0/ffff9612fcd6ec00 00010000:00010000:3.0:1788612672.468380:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788612672.480276:0:15814:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788612672.494857:0:15814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7e85 00000020:00000080:0.0:1788612672.494870:0:15814:0:(genops.c:885:class_export_put()) final put ffff9611c6b34000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788612672.494899:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c67e2000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788612672.494903:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c67e2000 2 00000020:01000004:0.0:1788612672.494906:0:15814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9611c67e2000 from lustre-OST0001 00000020:00000080:0.0:1788612672.494927:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612672.494938:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788612672.494941:0:15814:0:(genops.c:885:class_export_put()) final put ffff9612f7afa000/lustre-OST0001_UUID 00000020:00000080:0.0:1788612672.494944:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7afa000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788612672.494951:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788612672.495003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6b34000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788612672.495130:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d04a0405-b620-42fe-8569-8c55f54b9b5e->MGS 00010000:00010000:0.0:1788612672.495145:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc7bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612672.495177:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc7bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612672.495184:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788612672.495187:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788612672.495190:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788612672.495204:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612672.495208:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc7bde lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc7be5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612672.495223:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612672.495230:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612672.495235:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612672.495237:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788612672.495238:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788612672.495246:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9612c82b9000 00010000:00010000:0.0:1788612672.495249:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc805a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc8061 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788612672.495266:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9612c82b9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788612672.495270:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788612672.495272:0:15814:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788612672.495274:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788612672.495278:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788612672.495288:0:15814:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9611c80eed80 x1875495932305024/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788612677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788612672.495318:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788612672.495321:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1788612672.495957:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d04a0405-b620-42fe-8569-8c55f54b9b5e:3647:1875495932305024:0@lo:250:kworker.0 10000000:01000000:0.0:1788612672.495995:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788612672.496003:0:15814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7adb 00000020:00000080:0.0:1788612672.496009:0:15814:0:(genops.c:885:class_export_put()) final put ffff9612c909d000/d04a0405-b620-42fe-8569-8c55f54b9b5e 00000020:01000000:0.0:1788612672.496018:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.130@tcp (flags='') 00000020:00000080:0.0:1788612672.496022:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612672.496027:0:15814:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788612672.496031:0:15814:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9612d1e64d40) has no exports 00000020:00000080:1.0:1788612672.496055:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c909d000/d04a0405-b620-42fe-8569-8c55f54b9b5e for MGC192.168.203.130@tcp 10000000:01000000:3.0:1788612672.496105:0:6520:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788612672.496128:0:15814:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.130@tcp: client import never connected 00000100:00080000:0.0:1788612672.496131:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788612672.496134:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788612672.496136:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788612672.496138:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788612672.496183:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612672.496189:0:15814:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.130@tcp (uuid d04a0405-b620-42fe-8569-8c55f54b9b5e) 00000020:01000000:0.0:1788612672.496195:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788612672.496198:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612672.496202:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c82b9000 for MGC192.168.203.130@tcp 00000020:00000080:0.0:1788612672.496202:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612672.496210:0:15814:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9612fcd9d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788612672.496212:0:36:0:(genops.c:885:class_export_put()) final put ffff9612ec001800/d04a0405-b620-42fe-8569-8c55f54b9b5e 00000020:00080000:0.0:1788612672.496216:0:15814:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9612ea248000) has exports, disconnecting them 00000020:00080000:0.0:1788612672.496222:0:15814:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9612fcd9d800), last request at 1788612440 00000020:00000080:0.0:1788612672.496227:0:15814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7eaf 00000020:00080000:0.0:1788612672.496237:0:15814:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612fcd9d800): rc 0 00000020:00000080:0.0:1788612672.496240:0:15814:0:(genops.c:885:class_export_put()) final put ffff9612fcd9d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788612672.496285:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612ec001800/d04a0405-b620-42fe-8569-8c55f54b9b5e for MGC192.168.203.130@tcp 00000020:01000000:1.0:1788612672.496293:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.130@tcp (d04a0405-b620-42fe-8569-8c55f54b9b5e) 00000020:00000080:1.0:1788612672.497964:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcd9d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788612672.498924:0:15814:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788612672.498929:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788612672.498934:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612672.498940:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612672.498964:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130066b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788612672.499117:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612672.499125:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788612672.499130:0:15814:0:(genops.c:885:class_export_put()) final put ffff96130168d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788612672.499133:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788612672.499138:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788612672.499191:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788612672.499195:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612672.499200:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788612672.499206:0:15814:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9611c75c5800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788612672.499212:0:15814:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9611c64b99c0) has exports, disconnecting them 00000020:00080000:1.0:1788612672.499217:0:15814:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9611c75c5800), last request at 1788612440 00000020:00000080:1.0:1788612672.499221:0:15814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7ec4 00000020:00080000:1.0:1788612672.499243:0:15814:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c75c5800): rc 0 00000020:00000080:1.0:1788612672.499248:0:15814:0:(genops.c:885:class_export_put()) final put ffff9611c75c5800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788612672.499278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c75c5800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788612672.501552:0:15814:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788612672.501574:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788612672.501581:0:15814:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788612672.501587:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788612672.505577:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788612672.505785:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788612672.505908:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9612d0d68200:6507] 1 exiting: rc = 0 00000100:00100000:3.0:1788612672.533819:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9612c70ae800:6506] 0 exiting: rc = 1 00000020:00000080:3.0:1788612672.533904:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c75c7000 for lustre-MDT0001-lwp-OST0001 00000100:00100000:3.0:1788612672.533939:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.534173:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9612c93e2800:6510] 2 exiting: rc = 0 00000100:00100000:1.0:1788612672.537592:0:7465:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9612fcd25400:7465] 3 exiting: rc = 0 00000100:00100000:1.0:1788612672.537822:0:10342:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9611c79fda00:10342] 4 exiting: rc = 0 00000100:00100000:1.0:1788612672.537914:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9612c29d6c00:6508] 0 exiting: rc = 1 00000100:00100000:1.0:1788612672.537989:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9612d81ed600:6509] 1 exiting: rc = 0 00000100:00100000:3.0:1788612672.538148:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538166:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538174:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538180:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538186:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538191:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538197:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538203:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538209:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538215:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538222:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538228:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538233:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538239:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538245:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538249:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538255:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538260:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538265:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538272:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538278:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538283:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538288:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538301:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538307:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538313:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538318:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538322:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538328:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538333:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538338:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538344:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538348:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538354:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538359:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538365:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538370:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538375:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538379:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538382:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538386:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538389:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538392:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538396:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538399:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538402:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538405:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538407:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538410:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538412:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538416:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538419:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538421:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538424:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538427:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538429:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538432:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538435:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538444:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538447:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538450:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538454:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538457:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612672.538461:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788612672.540109:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612672.540185:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788612672.540192:0:15814:0:(genops.c:885:class_export_put()) final put ffff9611c75c2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788612672.540196:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c75c2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788612672.540202:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788612672.540252:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c67e2000 1 00000020:00000080:3.0:1788612672.540258:0:15814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc7e54 00000020:00000080:3.0:1788612672.540264:0:15814:0:(genops.c:885:class_export_put()) final put ffff96130168c800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788612672.540389:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788612672.540394:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612672.540399:0:15814:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788612672.540403:0:15814:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9611c69d3380) has no exports 00000020:00000080:0.0:1788612672.543442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788612672.593863:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612672.593877:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788612672.593884:0:15814:0:(genops.c:885:class_export_put()) final put ffff9611c67e7800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788612672.594220:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c67e7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788612672.594238:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788612672.594952:0:15814:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9611c67e0800 00000020:01000000:0.0:1788612672.594977:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788612672.594981:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612672.594986:0:15814:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788612672.594990:0:15814:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9612fe9e99c0) has no exports 00000020:00000080:0.0:1788612672.595011:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612672.595017:0:15814:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788612672.595020:0:15814:0:(genops.c:885:class_export_put()) final put ffff9612fe9f2800/OSS_uuid 00000020:00000080:0.0:1788612672.595023:0:15814:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fe9f2800/OSS_uuid for OSS 00000020:01000000:0.0:1788612672.595026:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788612672.595203:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9612eb7b4200:8441] 2 exiting: rc = 0 00000100:00100000:2.0:1788612672.595384:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96130044f600:8440] 1 exiting: rc = 0 00000100:00100000:2.0:1788612672.595427:0:8543:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff961300759c00:8543] 3 exiting: rc = 0 00000100:00100000:2.0:1788612672.595645:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96130044f000:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1788612672.595733:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595743:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595749:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595759:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595840:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595846:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595851:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595857:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595862:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595867:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595872:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595877:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595882:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595896:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595901:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595907:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595911:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595916:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595921:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595926:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595931:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595936:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595941:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595946:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595959:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595964:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595970:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595975:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595980:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595985:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595990:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.595995:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596000:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596004:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596009:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596014:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596019:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596024:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596028:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596036:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596043:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596048:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596053:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596058:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596063:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596068:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596072:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596077:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596082:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596087:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596092:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596097:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596102:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596106:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596111:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596116:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596121:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596125:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596130:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596138:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596143:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596148:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596153:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.596158:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1788612672.600850:0:6519:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788612672.601503:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9612eb7b5000:8442] 0 exiting: rc = 1 00000100:00100000:1.0:1788612672.602050:0:10299:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9611c67b8a00:10299] 2 exiting: rc = 0 00000100:00100000:1.0:1788612672.602122:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9612eb7b4800:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1788612672.602230:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602240:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602247:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602252:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602257:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602262:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602267:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602272:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602277:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602282:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602287:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602293:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602298:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602303:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602309:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602340:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602347:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602351:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602357:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602362:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602366:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602372:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602376:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602381:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602387:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602392:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602397:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602401:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602407:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602412:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602432:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602437:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602442:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602447:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602452:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602456:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602461:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602465:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602470:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602503:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602510:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602516:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602521:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602526:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602530:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602535:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602540:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602546:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602551:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602557:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602562:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602570:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602574:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602581:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602587:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602592:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602597:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602602:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602608:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602613:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602618:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602625:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602631:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.602643:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.608062:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9612c714b200:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1788612672.608859:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9612c714ba00:8445] 1 exiting: rc = 0 00000100:00100000:2.0:1788612672.609657:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9612c714b800:8446] 2 exiting: rc = 0 00000100:00100000:2.0:1788612672.609737:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609745:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609750:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609756:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609772:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609788:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609815:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609829:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609835:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609841:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609847:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609853:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609858:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609864:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609870:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609876:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609883:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609899:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609906:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609911:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609916:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609923:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609929:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609935:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609940:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609945:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609951:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609958:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609964:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609969:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.609992:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610000:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610006:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610012:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610018:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610025:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610030:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610036:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610042:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610048:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610054:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610059:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610072:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610078:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610083:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610090:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610097:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610103:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610108:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610114:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610119:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610125:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610130:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610136:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610150:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610158:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610187:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610195:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610200:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610204:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610210:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610216:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610221:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.610226:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.616542:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9612c92b3e00:8447] 0 exiting: rc = 1 00000100:00100000:0.0:1788612672.616638:0:9992:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9611c6486600:9992] 2 exiting: rc = 0 00000100:00100000:0.0:1788612672.617554:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9611c18cd000:8448] 1 exiting: rc = 0 00000100:00100000:2.0:1788612672.617704:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617712:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617719:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617724:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617729:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617734:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617738:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617743:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617747:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617753:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617758:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617838:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617843:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617861:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617866:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617872:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617877:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617881:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617898:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617904:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617909:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617915:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617920:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617925:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617930:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617935:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617940:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617945:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617950:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617955:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617960:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617966:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617971:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617977:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617984:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617989:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.617994:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618000:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618079:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618128:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618134:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618139:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618144:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618150:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618155:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618160:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618164:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618169:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618194:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618199:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618204:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618209:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618213:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618218:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618223:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618227:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618232:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618237:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618242:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618247:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618251:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618256:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618261:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.618266:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612672.620051:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff961300751000:8449] 0 exiting: rc = 1 00000100:00100000:1.0:1788612672.620241:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9611c139be00:8450] 1 exiting: rc = 0 00000100:00100000:2.0:1788612672.620353:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620361:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620367:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620374:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620396:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620403:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620410:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620416:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620423:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620429:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620436:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620443:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620449:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620456:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620463:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620470:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620526:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620534:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620541:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620559:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620565:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620571:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620577:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620582:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620588:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620593:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620599:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620605:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620627:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620634:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620640:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620646:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620652:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620657:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620662:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620669:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620674:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620680:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620686:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620692:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620713:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620719:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620726:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620731:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620739:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620743:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620749:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620759:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620915:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620922:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620928:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620934:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620956:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620962:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620975:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620981:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620989:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.620995:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.621000:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.621089:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.621097:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.621104:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.621110:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612672.621117:0:15814:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788612672.632641:0:15814:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788612692.100242:0:16578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788612702.954102:0:17177:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788612702.954109:0:17177:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788612702.954111:0:17177:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788612702.954230:0:17177:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9611c816d000 00000020:01000004:2.0:1788612702.954246:0:17177:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788612702.954253:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788612702.954267:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9611c5a219c0) 00000020:00000080:2.0:1788612702.954281:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788612703.063333:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.064403:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788612703.070808:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.079432:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.079891:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.080310:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.080717:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.080947:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.081279:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.081530:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.081779:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.082019:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.082350:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.082599:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.082851:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.083074:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.083455:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.084437:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.084751:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.084984:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.085317:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.085667:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.085914:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.086162:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.086567:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.086766:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.086952:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.087228:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.087415:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.088085:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.090059:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.090617:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.090870:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.091109:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788612703.091438:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788612703.091955:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.092225:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788612703.092650:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788612703.092883:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788612703.093272:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.093890:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788612703.094094:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.094388:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.094632:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.094839:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788612703.095020:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788612703.095307:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.096802:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.097737:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.103167:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.103967:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.104217:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788612703.104402:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1788612703.108382:0:17177:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788612703.108825:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788612703.108834:0:17177:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612703.108848:0:17177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc9098 00000020:01000004:2.0:1788612703.108856:0:17177:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788612703.108860:0:17177:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788612703.108865:0:17177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9611c816d000 from MGS 00000020:01000004:2.0:1788612703.108869:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788612703.108878:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9611c5a24d40) 00000020:00000080:2.0:1788612703.108888:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788612703.108943:0:17177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c816d000 from MGS, refs=2 00080000:01000000:2.0:1788612703.108947:0:17177:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788612703.108951:0:17177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc90a6 00000100:00100000:2.0:1788612703.109044:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788612703.109192:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788612703.109198:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788612703.109772:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788612703.109780:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788612703.110417:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612703.110866:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788612703.110872:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788612703.112005:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788612703.112016:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788612703.112460:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788612703.112466:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788612703.113109:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612703.113112:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612703.113114:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612703.113429:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612703.113431:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612703.113433:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612703.114011:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:2.0:1788612703.119407:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1788612703.122580:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612703.122730:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788612703.122764:0:17177:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788612703.122820:0:17177:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788612703.124013:0:17177:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788612703.124793:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612703.124950:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788612703.124957:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788612703.129920:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788612703.129933:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788612703.130289:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788612703.130294:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788612703.131280:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788612703.131302:0:17177:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:2.0:1788612703.131304:0:17177:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788612703.131331:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:2.0:1788612703.131343:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (ffff9611c5a23380) 00000020:00000080:2.0:1788612703.131358:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788612703.131435:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96130066d800@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612703.131768:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:2.0:1788612703.131776:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788612703.132129:0:17194:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788612703.132237:0:17195:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788612703.132304:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid d240c1fb-ce1c-496f-9994-daecd37f5c24) 00000020:00000080:0.0:1788612703.132322:0:17177:0:(genops.c:1385:class_connect()) connect: client d240c1fb-ce1c-496f-9994-daecd37f5c24, cookie 0x1f8616bf0bc90b4 00000100:00080000:0.0:1788612703.132335:0:17177:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612703.132340:0:17177:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff96130066d800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612703.132373:0:17177:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a9c00 x1875495932305536/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612703.132404:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d240c1fb-ce1c-496f-9994-daecd37f5c24->MGS 00000020:01000004:0.0:1788612703.132426:0:17177:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788612703.132430:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788612703.132442:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9611c69d3380) 00000020:00000080:0.0:1788612703.132451:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788612703.132629:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d240c1fb-ce1c-496f-9994-daecd37f5c24:3647:1875495932305536:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788612703.132706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612703.137610:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932305536 00000100:00100000:1.0:1788612703.137622:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932305536 00000100:00100000:1.0:1788612703.137659:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612703.137667:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3647:x1875495932305536:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788612703.137702:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d240c1fb-ce1c-496f-9994-daecd37f5c24@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:1.0:1788612703.137725:0:17192:0:(genops.c:1385:class_connect()) connect: client d240c1fb-ce1c-496f-9994-daecd37f5c24, cookie 0x1f8616bf0bc90c2 00000100:00080000:1.0:1788612703.137839:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9611c81b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612703.137924:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+5:3647:x1875495932305536:12345-0@lo:250:mount.lustre.0 Request processed in 256us (5217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612703.137931:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612703.137981:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788612703.137989:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1788612703.137996:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788612703.138001:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788612703.138003:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96130066d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788612703.138006:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788612703.138020:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788612703.138025:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d240c1fb-ce1c-496f-9994-daecd37f5c24:3647:1875495932305536:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788612703.159065:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612703.159268:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788612703.159274:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788612703.160304:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788612703.160314:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788612703.161425:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788612703.161434:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788612703.162395:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612703.162993:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788612703.162999:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788612703.164940:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788612703.164952:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788612703.229409:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612703.233656:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788612703.233666:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788612703.236366:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788612703.236381:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788612703.237441:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612703.237652:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788612703.237658:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788612703.239387:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788612703.239397:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788612703.240449:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612703.244256:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788612703.244266:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788612703.245656:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788612703.245666:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788612703.246372:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612703.246562:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788612703.246568:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788612703.247337:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788612703.247344:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788612703.280537:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612703.280761:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788612703.280768:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788612703.282591:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788612703.282609:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788612703.283967:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788612703.283977:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788612703.285190:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788612703.285219:0:17177:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788612703.285225:0:17177:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788612703.285330:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788612703.285361:0:17177:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788612703.285365:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788612703.285367:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612703.285369:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612703.285370:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612703.285371:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612703.285373:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612703.285374:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612703.285375:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612703.285377:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612703.285378:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612703.285380:0:17177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788612703.285382:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612703.285384:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612703.285385:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612703.285386:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612703.285386:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612703.285387:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612703.285388:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612703.285389:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612703.285390:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612703.285391:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612703.285417:0:17177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788612703.285435:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932305664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612703.285714:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.285886:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612703.286199:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932305664 00000100:00100000:1.0:1788612703.286207:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932305664 00000100:00100000:1.0:1788612703.286257:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612703.286266:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+5:17177:x1875495932305664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788612703.286311:0:17193:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788612703.286314:0:17193:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788612703.286317:0:17193:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788612703.288290:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788612703.290999:0:17193:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788612703.295001:0:17215:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788612703.295009:0:17215:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788612703.295011:0:17215:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788612703.295014:0:17215:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788612703.295343:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788612703.295598:0:17193:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788612703.295608:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788612703.301046:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+5:17177:x1875495932305664:12345-0@lo:253:mount.lustre.0 Request processed in 14772us (15324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612703.301061:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612703.301460:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932305664:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788612703.301513:0:17177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788612703.301528:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612703.301530:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612703.301531:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612703.301533:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612703.301534:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612703.301535:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612703.301537:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612703.301538:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612703.301540:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612703.301541:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788612703.301565:0:17177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9611c816d000 from lustre-MDT0000 10000000:01000000:3.0:1788612703.301595:0:17177:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788612703.301598:0:17177:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788612703.301603:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9611c5a23380 10000000:01000000:3.0:1788612703.301607:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612703.301614:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9611c5a23380 from 1 10000000:01000000:3.0:1788612703.301617:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788612703.301655:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.301665:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.301684:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.301705:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932305792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612703.301759:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.301853:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612703.302299:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932305792 00000100:00100000:1.0:1788612703.302306:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932305792 00000100:00100000:1.0:1788612703.302395:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612703.302404:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+5:17177:x1875495932305792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612703.302417:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612703.302434:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799ba00/0x1f8616bf0bc90d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc90c9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612703.302458:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799ba00/0x1f8616bf0bc90d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc90c9 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612703.302517:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799ba00/0x1f8616bf0bc90d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc90c9 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612703.302527:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ba00, rc 0) 00000100:00100000:1.0:1788612703.302579:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+6:17177:x1875495932305792:12345-0@lo:101:mount.lustre.0 Request processed in 176us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612703.302586:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612703.302664:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932305792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612703.302690:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.302700:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612703.302772:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932305920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612703.302813:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.303433:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932305920 00000100:00100000:3.0:1788612703.303440:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932305920 00000100:00100000:3.0:1788612703.303468:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612703.303504:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+6:17177:x1875495932305920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.303596:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+6:17177:x1875495932305920:12345-0@lo:501:mount.lustre.0 Request processed in 121us (781us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612703.303603:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612703.303932:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e09b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.303952:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932305920:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788612703.303987:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788612703.304010:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304019:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612703.304028:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9611c816d000 10000000:01000000:3.0:1788612703.304033:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788612703.304038:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9611c816d000 10000000:01000000:3.0:1788612703.304040:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788612703.304043:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9611c816d000 from 1 10000000:01000000:3.0:1788612703.304046:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788612703.304070:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304088:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304106:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.304131:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612703.304174:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.304199:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932306048 00000100:00100000:3.0:1788612703.304204:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932306048 00000100:00100000:3.0:1788612703.304226:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612703.304233:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+6:17177:x1875495932306048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.304241:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612703.304254:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7241600/0x1f8616bf0bc90de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc90d7 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304272:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7241600/0x1f8616bf0bc90de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc90d7 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304281:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7241600/0x1f8616bf0bc90de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc90d7 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304290:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241600, rc 0) 00000100:00100000:3.0:1788612703.304315:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+7:17177:x1875495932306048:12345-0@lo:101:mount.lustre.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.304321:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612703.304346:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.304358:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.304369:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304378:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612703.304390:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788612703.304400:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304407:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612703.304413:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788612703.304416:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612703.304420:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9611c816d000 10000000:01000000:3.0:1788612703.304423:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788612703.304426:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788612703.304428:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788612703.304443:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304449:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304456:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.304467:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612703.304526:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.304546:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932306176 00000100:00100000:3.0:1788612703.304550:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932306176 00000100:00100000:3.0:1788612703.304570:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612703.304576:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+7:17177:x1875495932306176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.304582:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612703.304590:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7241e00/0x1f8616bf0bc90ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc90e5 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304616:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7241e00/0x1f8616bf0bc90ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc90e5 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304626:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7241e00/0x1f8616bf0bc90ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc90e5 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304632:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241e00, rc 0) 00000100:00100000:3.0:1788612703.304657:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+8:17177:x1875495932306176:12345-0@lo:101:mount.lustre.0 Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.304663:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612703.304697:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.304709:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.304731:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.304739:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.305091:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.305119:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.305143:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932306304 00000100:00100000:3.0:1788612703.305147:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932306304 00000100:00100000:3.0:1788612703.305166:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612703.305172:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+8:17177:x1875495932306304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.305285:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17177:x1875495932306304:12345-0@lo:501:mount.lustre.0 Request processed in 113us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.305300:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612703.305323:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.305335:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.305361:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612703.305396:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.305416:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932306432 00000100:00100000:3.0:1788612703.305419:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932306432 00000100:00100000:3.0:1788612703.305436:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612703.305441:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17177:x1875495932306432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612703.305990:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.309410:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17177:x1875495932306432:12345-0@lo:503:mount.lustre.0 Request processed in 3959us (4004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.309425:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612703.309524:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932306432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612703.311159:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17216:1875495932306560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.311234:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612703.311276:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3351600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.311367:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932306560 00000100:00100000:3.0:1788612703.311373:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932306560 00000100:00100000:3.0:1788612703.311418:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612703.311426:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17216:x1875495932306560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612703.313264:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17216:x1875495932306560:12345-0@lo:502:llog_process_th.0 Request processed in 1831us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.313277:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612703.313290:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17216:1875495932306560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612703.313323:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612703.313334:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.313336:0:17216:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788612703.313342:0:17216:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788612703.313345:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612703.313361:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9612fe9ecd40) 00000020:00000080:1.0:1788612703.313377:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788612703.313383:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788612703.313505:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788612703.313513:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc90fa 00000020:00000080:1.0:1788612703.313732:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788612703.313736:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612703.313740:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.313742:0:17216:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788612703.313744:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612703.313748:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.313749:0:17216:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788612703.313758:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612703.313765:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9612fe9eb380) 00000020:00000080:1.0:1788612703.313774:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788612703.313777:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788612703.313918:0:17216:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788612703.313921:0:17216:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788612703.313930:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788612703.313985:0:17216:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c816d000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788612703.313999:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9612fe9e99c0) 00000020:00000080:1.0:1788612703.314006:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788612703.314053:0:17216:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788612703.314059:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc910f 00000020:00000080:1.0:1788612703.314263:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788612703.314270:0:17216:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788612703.314275:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1f8616bf0bc9116 00080000:01000000:1.0:1788612703.314281:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788612703.314286:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc911d 00010000:00010000:2.0:1788612703.396115:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788612703.398951:0:17216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788612703.399350:0:17216:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788612703.399845:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9611c5a20000) 00000020:00000080:2.0:1788612703.399866:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788612703.399938:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788612703.399944:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc912b 00000020:00000080:3.0:1788612703.414809:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788612703.418939:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1f8616bf0bc9132 00000020:00000080:2.0:1788612703.420862:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788612703.420882:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612703.420891:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.420893:0:17216:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788612703.420896:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788612703.420898:0:17216:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788612703.420900:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612703.420901:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612703.420903:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788612703.420905:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.420906:0:17216:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788612703.420909:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612703.420913:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.420914:0:17216:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788612703.420918:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788612703.420960:0:17216:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788612703.420974:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612703.420976:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.420977:0:17216:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788612703.420980:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612703.420983:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.420984:0:17216:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788612703.420986:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788612703.420991:0:17216:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:2.0:1788612703.421015:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612703.421031:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9612fcfc0000) 00000020:00000080:2.0:1788612703.421044:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788612703.421048:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788612703.421096:0:17216:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788612703.421101:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788612703.421115:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc9140 00010000:00080000:2.0:1788612703.421142:0:17216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612f7afa800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612703.422685:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788612703.430165:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612703.430179:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788612703.430217:0:17216:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788612703.430236:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc9147 00000100:00080000:0.0:1788612703.430245:0:17216:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612703.430251:0:17216:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612f7afa800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612703.430284:0:17216:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79a8380 x1875495932306688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612703.430377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932306688:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788612703.430444:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612703.430644:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932306688 00000100:00100000:2.0:1788612703.430651:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932306688 00000100:00100000:2.0:1788612703.430695:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612703.430702:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932306688:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788612703.430717:0:17203:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788612703.443953:0:17216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788612703.444056:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612703.444062:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612703.444065:0:17216:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788612703.444068:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788612703.444071:0:17216:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788612703.444073:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788612703.444074:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788612703.444076:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788612703.444078:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612703.444080:0:17216:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788612703.444082:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612703.444087:0:17216:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788612703.444091:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612703.444092:0:17216:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788612703.444095:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788612703.444098:0:17216:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1788612703.444119:0:17216:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788612703.444121:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612703.444136:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9611c69d0000) 00000020:00000080:0.0:1788612703.444156:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788612703.444160:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788612703.444247:0:17216:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788612703.444253:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788612703.444259:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc9155 00010000:00080000:0.0:1788612703.444284:0:17216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961300767000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612703.444514:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788612703.447655:0:17216:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788612703.448687:0:17216:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788612703.455172:0:17216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612703.455888:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788612703.468859:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1788612703.475279:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932306688:12345-0@lo:38:llog_process_th.0 Request processed in 44572us (44830us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612703.475298:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788612703.475648:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612703.475655:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612703.475659:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932306688:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788612703.475983:0:17222:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788612703.475989:0:17222:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788612703.476691:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612703.476703:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788612703.476739:0:17216:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788612703.476757:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc915c 00000100:00080000:3.0:1788612703.476764:0:17216:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612703.476770:0:17216:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff961300767000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612703.476799:0:17216:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed58380 x1875495932306816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612703.476817:0:17216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788612703.476874:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612703.476878:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612703.476880:0:17216:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788612703.476883:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612703.476886:0:17216:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788612703.476888:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612703.476889:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612703.476891:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612703.476893:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612703.476895:0:17216:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612703.476897:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788612703.476901:0:17216:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788612703.476904:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612703.476905:0:17216:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788612703.476908:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612703.476912:0:17216:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788612703.476932:0:17216:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788612703.476934:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612703.476945:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9612ea24cd40) 00000020:00000080:3.0:1788612703.476955:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788612703.476958:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612703.477019:0:17216:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788612703.477031:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788612703.477037:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc916a 00010000:00080000:3.0:1788612703.477063:0:17216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961300767800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612703.477251:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788612703.477307:0:17216:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788612703.477320:0:17216:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788612703.477664:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932306816:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788612703.477729:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932306816 offset 0 length 520: 4 00000040:00080000:1.0:1788612703.480440:0:17216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612703.480757:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788612703.480912:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788612703.481294:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788612703.481299:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788612703.482660:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612703.482681:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788612703.482729:0:17216:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788612703.482751:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc9171 00000100:00080000:1.0:1788612703.482763:0:17216:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612703.482769:0:17216:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961300767800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612703.482803:0:17216:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80edc00 x1875495932306944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612703.482834:0:17216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788612703.482895:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612703.482898:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.482901:0:17216:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788612703.482904:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612703.482907:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.482909:0:17216:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788612703.482912:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788612703.482914:0:17216:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788612703.482916:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612703.482918:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.482920:0:17216:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788612703.482922:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612703.482924:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.482925:0:17216:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788612703.482928:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788612703.482959:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17216:1875495932307072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.483033:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612703.483076:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307072 00000100:00100000:1.0:1788612703.483082:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307072 00000100:00100000:1.0:1788612703.483120:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612703.483128:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17216:x1875495932307072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.483235:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17216:x1875495932307072:12345-0@lo:502:llog_process_th.0 Request processed in 107us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612703.483242:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612703.483292:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fb8b3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612703.483313:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17216:1875495932307072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612703.483338:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612703.483345:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612703.483347:0:17216:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788612703.483350:0:17216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788612703.483596:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788612703.483618:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788612703.483638:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483649:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612703.483658:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c816d000 from 1 10000000:01000000:3.0:1788612703.483661:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612703.483695:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483703:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483712:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.483725:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612703.483751:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.483770:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.483785:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307200 00000100:00100000:3.0:1788612703.483788:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307200 00000100:00100000:3.0:1788612703.483816:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612703.483822:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+9:17177:x1875495932307200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.483830:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612703.483841:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9178 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483860:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483870:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483879:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241a00, rc 0) 00000100:00100000:3.0:1788612703.483904:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+10:17177:x1875495932307200:12345-0@lo:101:mount.lustre.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.483910:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612703.483938:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.483949:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.483958:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.484415:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307328:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788612703.484449:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.484461:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.484511:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307328 00000100:00100000:3.0:1788612703.484515:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307328 00000100:00100000:3.0:1788612703.484596:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612703.484603:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+10:17177:x1875495932307328:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788612703.484616:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788612703.484622:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788612703.484691:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+10:17177:x1875495932307328:12345-0@lo:256:mount.lustre.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.484698:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612703.484732:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307328:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788612703.485271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932306944:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788612703.485302:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932306944 offset 0 length 520: 4 10000000:01000000:3.0:1788612703.486058:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612703.486110:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.486122:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612703.486130:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c816d000 from 1 10000000:01000000:3.0:1788612703.486132:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612703.486163:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.486173:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.486182:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.486199:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612703.486235:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.486275:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c793b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612703.486355:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307456 00000100:00100000:0.0:1788612703.486361:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307456 00000100:00100000:0.0:1788612703.486397:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612703.486404:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+10:17177:x1875495932307456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612703.486414:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612703.486427:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9186 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.486446:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.486456:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.486464:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612703.486529:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932307456:12345-0@lo:101:mount.lustre.0 Request processed in 125us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612703.486535:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612703.486878:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612703.486893:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.486902:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612703.486970:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612703.486993:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612703.487019:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d15bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.487104:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307584 00000100:00100000:3.0:1788612703.487108:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307584 00000100:00100000:3.0:1788612703.487134:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612703.487141:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932307584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.487257:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932307584:12345-0@lo:501:mount.lustre.0 Request processed in 116us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.487264:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612703.487514:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612703.487541:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612703.487576:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612703.487604:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d15bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.487716:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307712 00000100:00100000:3.0:1788612703.487720:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307712 00000100:00100000:3.0:1788612703.487746:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612703.487753:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932307712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612703.487827:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932307712:12345-0@lo:503:mount.lustre.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.487834:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612703.488223:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932307712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612703.492215:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17226:1875495932307840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612703.492300:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612703.492343:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612703.492402:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307840 00000100:00100000:0.0:1788612703.492409:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307840 00000100:00100000:0.0:1788612703.492454:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612703.492463:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17226:x1875495932307840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612703.492966:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17226:x1875495932307840:12345-0@lo:502:llog_process_th.0 Request processed in 503us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612703.492975:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612703.493148:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17226:1875495932307840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612703.493179:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612703.493189:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493191:0:17226:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788612703.493197:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c816d000 00000020:00000080:2.0:1788612703.493200:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612703.493207:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612703.493209:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493211:0:17226:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788612703.493213:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612703.493215:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493217:0:17226:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788612703.493220:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c816d000 00000020:00000080:2.0:1788612703.493221:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612703.493274:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612703.493276:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493278:0:17226:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788612703.493280:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612703.493282:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493283:0:17226:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612703.493286:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c816d000 00000020:00000080:2.0:1788612703.493288:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612703.493306:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612703.493309:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493311:0:17226:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612703.493313:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612703.493321:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.493322:0:17226:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788612703.493326:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c816d000 00000020:00000080:2.0:1788612703.493328:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788612703.493362:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17226:1875495932307968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612703.493396:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612703.493416:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.493500:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932307968 00000100:00100000:3.0:1788612703.493506:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932307968 00000100:00100000:3.0:1788612703.493534:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612703.493541:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17226:x1875495932307968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612703.493616:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17226:x1875495932307968:12345-0@lo:502:llog_process_th.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.493623:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612703.498074:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17226:1875495932307968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612703.498120:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612703.498131:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612703.498134:0:17226:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788612703.498139:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788612703.499973:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788612703.500010:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612703.502600:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.502617:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612703.502705:0:17177:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788612703.502708:0:17177:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9611c816d000 10000000:01000000:3.0:1788612703.502711:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9611c816d000 10000000:01000000:3.0:1788612703.502715:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612703.502721:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9611c816d000 from 1 10000000:01000000:3.0:1788612703.502724:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612703.502760:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.502769:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.502780:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.502803:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612703.502864:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.502915:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.502937:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308096 00000100:00100000:3.0:1788612703.502943:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308096 00000100:00100000:3.0:1788612703.502980:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612703.502989:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932308096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.503001:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612703.503013:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240400/0x1f8616bf0bc919b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9194 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.503036:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240400/0x1f8616bf0bc919b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9194 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.503058:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240400/0x1f8616bf0bc919b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9194 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.503066:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240400, rc 0) 00000100:00100000:3.0:1788612703.503104:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17177:x1875495932308096:12345-0@lo:101:mount.lustre.0 Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.503110:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612703.503158:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612703.503171:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.503181:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612703.503234:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.503259:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.503280:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612703.503943:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308224 00000100:00100000:0.0:1788612703.503950:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308224 00000100:00100000:0.0:1788612703.504645:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612703.504657:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17177:x1875495932308224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612703.504828:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17177:x1875495932308224:12345-0@lo:501:mount.lustre.0 Request processed in 173us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612703.504835:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612703.504916:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612703.504956:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612703.504994:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.505390:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612703.505415:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308352 00000100:00100000:2.0:1788612703.505420:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308352 00000100:00100000:2.0:1788612703.505445:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612703.505451:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17177:x1875495932308352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612703.505557:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17177:x1875495932308352:12345-0@lo:503:mount.lustre.0 Request processed in 105us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612703.505564:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612703.505984:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612703.518946:0:17230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17230:1875495932308480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.519028:0:17230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612703.519077:0:17230:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fb8b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612703.519316:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308480 00000100:00100000:2.0:1788612703.519323:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308480 00000100:00100000:2.0:1788612703.519379:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612703.519389:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17230:x1875495932308480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612703.519574:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17230:x1875495932308480:12345-0@lo:502:llog_process_th.0 Request processed in 186us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612703.519582:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612703.519744:0:17230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17230:1875495932308480:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788612703.519798:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788612703.519812:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9612fe9e8000) 00000020:00000080:1.0:1788612703.519828:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788612703.519914:0:17230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c816d000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788612703.519918:0:17230:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c816d000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788612703.519921:0:17230:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c816d000 4 00010000:00080000:1.0:1788612703.519955:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c674a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788612703.526739:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788612703.526924:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788612703.526964:0:17230:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788612703.526977:0:17230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1f8616bf0bc91a9 00000100:00080000:1.0:1788612703.526987:0:17230:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612703.526993:0:17230:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9611c674a000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612703.527025:0:17230:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80ef800 x1875495932308608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612703.527088:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932308608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788612703.527169:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612703.527223:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788612703.532198:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308608 00000100:00100000:0.0:1788612703.532214:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308608 00000100:00100000:0.0:1788612703.532253:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612703.532262:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932308608:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612703.536452:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932308608:12345-0@lo:38:llog_process_th.0 Request processed in 4182us (9276us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788612703.536466:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612703.538117:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612703.538129:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c674a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612703.538137:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788612703.538142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932308608:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788612703.542646:0:17230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17230:1875495932308736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.542732:0:17230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612703.542778:0:17230:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.542898:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308736 00000100:00100000:3.0:1788612703.542905:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308736 00000100:00100000:3.0:1788612703.542946:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612703.542960:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17230:x1875495932308736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612703.543077:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17230:x1875495932308736:12345-0@lo:502:llog_process_th.0 Request processed in 117us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.543085:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612703.543233:0:17230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17230:1875495932308736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.543277:0:17230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17230:1875495932308864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.543311:0:17230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612703.543332:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308864 00000100:00100000:1.0:1788612703.543336:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308864 00000100:00100000:1.0:1788612703.543364:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612703.543371:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17230:x1875495932308864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612703.543430:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17230:x1875495932308864:12345-0@lo:502:llog_process_th.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612703.543558:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612703.543585:0:17230:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612703.543597:0:17230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d240c1fb-ce1c-496f-9994-daecd37f5c24:17230:1875495932308864:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788612703.543613:0:17230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788612703.543857:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788612703.543893:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612703.543913:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612703.543924:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788612703.543964:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788612703.543966:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612703.543968:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612703.543969:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612703.543970:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612703.543972:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612703.543973:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612703.543974:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612703.543976:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612703.543977:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612703.543981:0:17177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788612703.543983:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612703.543985:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612703.543986:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612703.543987:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612703.543989:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612703.543990:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612703.543991:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612703.543992:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612703.543993:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612703.543994:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612703.544008:0:17177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788612703.544021:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308992:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612703.544054:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612703.544071:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7ad23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612703.544089:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932308992 00000100:00100000:3.0:1788612703.544093:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932308992 00000100:00100000:3.0:1788612703.544117:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612703.544124:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c32b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17177:x1875495932308992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612703.544141:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788612703.544153:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788612703.547834:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788612703.547846:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788612703.547900:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788612703.547905:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788612703.547928:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.547947:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.547955:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.547993:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.548008:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 12 pid: 17192 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612703.548023:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932309120:0@lo:104: 00000100:00100000:2.0:1788612703.548083:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612703.548119:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612703.550684:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309120 00000100:00100000:2.0:1788612703.550697:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309120 00000100:00100000:2.0:1788612703.550742:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612703.550757:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932309120:12345-0@lo:104: 00010000:00010000:2.0:1788612703.550775:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.550860:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612703.550866:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932309120:12345-0@lo:104: Request processed in 111us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612703.550873:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612703.550917:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932309120:0@lo:104: 00010000:00010000:2.0:1788612703.550940:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.551648:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612703.551656:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.551665:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612703.551670:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.551689:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612703.551696:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612703.551703:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612703.551741:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.551758:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612703.551777:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.551784:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7241c00/0x1f8616bf0bc9178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc917f expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.551805:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612703.551807:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612703.551809:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612703.551840:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612703.551854:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932309248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612703.551910:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612703.551970:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309248 00000100:00100000:0.0:1788612703.551976:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309248 00010000:00010000:0.0:1788612703.551997:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 13 pid: 17192 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612703.552018:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612703.552025:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+13:3649:x1875495932309248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612703.552035:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612703.552039:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 13 pid: 17192 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552059:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 13 pid: 17192 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552071:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7241a00/0x1f8616bf0bc917f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9178 expref: 13 pid: 17192 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552085:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552092:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788612703.552106:0:17183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004201969s 00010000:00010000:0.0:1788612703.552110:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552116:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552122:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552128:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552133:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612703.552137:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552145:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552170:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612703.552179:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612703.552215:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:3649:x1875495932309248:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612703.552221:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612703.552256:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932309248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612703.553618:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c32b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17177:x1875495932308992:12345-0@lo:253:mount.lustre.0 Request processed in 9489us (9557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612703.553628:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612703.553729:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17177:1875495932308992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788612703.553743:0:17177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788612703.553746:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612703.553748:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612703.553749:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612703.553750:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612703.553751:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612703.553753:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612703.553754:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612703.553756:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612703.553757:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612703.553758:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788612703.553771:0:17177:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788612703.555925:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.555943:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612703.555951:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37600/0x1f8616bf0bc91b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612703.589706:0:17177:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788612703.591975:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788612703.592247:0:17238:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788612703.592252:0:17238:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788612703.592590:0:17239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788612703.592637:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788612703.592989:0:17239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788612703.593015:0:17240:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9611c80ee680 x1875495932309376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612703.593027:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00000040:01000000:0.0:1788612703.593333:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788612703.593367:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788612703.594250:0:17177:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788612703.594261:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788612703.594308:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612703.596066:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788612703.596107:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788612703.596159:0:17239:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788612703.596803:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788612703.596840:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788612703.603174:0:17177:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788612703.605162:0:17177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788612703.611279:0:17177:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788612703.611320:0:17177:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9b941a33988 00100000:10000000:0.0:1788612703.611329:0:17177:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788612703.612048:0:17177:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788612703.612063:0:17177:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788612703.612080:0:17177:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788612703.612103:0:17177:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788612703.617191:0:17177:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612703.617378:0:17177:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612704.176076:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612704.569109:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612704.625426:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 10000000:01000000:2.0:1788612704.879720:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788612704.879729:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c816d000 from 7 10000000:01000000:2.0:1788612704.879734:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788612704.879782:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612704.879794:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612704.879820:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612704.879846:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932309504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612704.879915:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612704.880040:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788612704.887016:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309504 00000100:00100000:1.0:1788612704.887030:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309504 00000100:00100000:1.0:1788612704.887100:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612704.887111:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c65fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+11:17195:x1875495932309504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612704.887126:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612704.887145:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc91b7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612704.887186:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612704.887198:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612704.887206:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a600, rc 0) 00000100:00100000:1.0:1788612704.887290:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c65fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17195:x1875495932309504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (7374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612704.887297:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612704.887578:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932309504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612704.887607:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612704.887617:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612704.887689:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932309632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788612704.887731:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612704.887766:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612704.887823:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309632 00000100:00100000:3.0:1788612704.887834:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309632 00000100:00100000:3.0:1788612704.887869:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612704.887876:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c65f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17195:x1875495932309632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788612704.887891:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612704.887905:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612704.887908:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788612704.887992:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c65f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17195:x1875495932309632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612704.887999:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612704.888190:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932309632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788612704.888230:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612704.888237:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612704.888246:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612705.201796:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612705.584455:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788612705.651295:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788612706.225706:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612706.683101:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788612707.253710:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612707.698908:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788612708.271694:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612708.313835:0:17483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788612708.724041:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00000100:00080000:3.0:1788612708.847807:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612708.847814:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788612708.847818:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612708.847826:0:15779:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1788612708.847831:0:15779:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612708.847838:0:15779:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612f7afa800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612708.847858:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed58700 x1875495932309888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612708.847876:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612708.847879:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612708.847882:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612708.847885:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612708.847888:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612708.847890:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612708.847904:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9611c674a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612708.847909:0:15779:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9611c674a000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612708.847921:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed58000 x1875495932310016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612708.847947:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932309888:0@lo:38:kworker.0 00000100:00100000:3.0:1788612708.848060:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612708.848106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932310016:0@lo:38:kworker.0 00000100:00100000:3.0:1788612708.848146:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612708.848189:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309888 00000100:00100000:3.0:1788612708.848197:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309888 00000100:00100000:3.0:1788612708.848227:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612708.848234:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932309888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788612708.848251:0:17204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788612708.850615:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612708.850647:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932309760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612708.850712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612708.850769:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932310016 00000100:00100000:2.0:1788612708.850775:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932310016 00000100:00100000:2.0:1788612708.850802:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612708.850808:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932310016:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788612708.850829:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788612708.850863:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1f8616bf0bc91c5 00000004:00100000:2.0:1788612708.850875:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788612708.850998:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9612c7665800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612708.851045:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875495932310016:12345-0@lo:38:kworker.0 Request processed in 236us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612708.851052:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612708.852679:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309760 00000100:00100000:2.0:1788612708.852690:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309760 00000100:00100000:2.0:1788612708.852740:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612708.852749:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:3648:x1875495932309760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612708.852812:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:3648:x1875495932309760:12345-0@lo:400:kworker.0 Request processed in 64us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612708.852818:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612708.852868:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932309760:0@lo:400:kworker.0 00010000:00080000:2.0:1788612708.854702:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fed58000 x1875495932310016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612708.854721:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788612708.854728:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788612708.854733:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788612708.854737:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c674a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788612708.854756:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932310016:0@lo:38:kworker.0 00000100:00100000:3.0:1788612708.877403:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932309888:12345-0@lo:38:kworker.0 Request processed in 29160us (29334us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612708.877418:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788612708.879363:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612708.879374:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612708.879379:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932309888:0@lo:38:kworker.0 00000020:00000004:2.0:1788612709.242391:0:17535:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612709.242610:0:17535:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788612709.305990:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612709.743749:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00000020:00000004:2.0:1788612710.262179:0:17585:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612710.267322:0:17585:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788612710.320678:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612710.767614:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:3.0:1788612711.348585:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612711.791597:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612712.372012:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612712.818123:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612713.395134:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612713.842160:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00000100:00100000:0.0:1788612713.967950:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612703/real 1788612703] req@ffff9611c80edc00 x1875495932306944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612713 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612713.968002:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9611c80edc00 x1875495932306944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612713 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612713.969761:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612703/real 1788612703] req@ffff9612fed58380 x1875495932306816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612713 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612713.969795:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fed58380 x1875495932306816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612713 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612713.969818:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612713.973655:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612713.973666:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932306944:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788612713.973679:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612713.973913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788612713.973918:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788612713.973921:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612713.973926:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1788612713.973931:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612713.973938:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612f7afa800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612713.973962:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80ed880 x1875495932310272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612713.973973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612713.973975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788612713.973988:0:36:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612713.973992:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1788612713.973994:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788612713.973998:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff961300767000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612713.974009:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80efb80 x1875495932310400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612713.974018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612713.974021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612713.974022:0:36:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612713.974025:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1788612713.974027:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788612713.974029:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961300767800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612713.974039:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80ef100 x1875495932310528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612713.974271:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932310144:0@lo:400:kworker.0 00000100:00100000:1.0:1788612713.974339:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932310656:0@lo:400:kworker.0 00000100:00100000:3.0:1788612713.974393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612713.974429:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612713.974540:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612713.974547:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932306816:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788612713.974699:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932310272:0@lo:38:kworker.0 00000100:00100000:0.0:1788612713.974798:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612713.974900:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932310400:0@lo:8:kworker.0 00000400:00000100:0.0:1788612713.974924:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932310400 offset 0 length 520: 4 00000100:00100000:0.0:1788612713.974960:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932310528:0@lo:8:kworker.0 00000400:00000100:0.0:1788612713.974984:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932310528 offset 0 length 520: 4 00000100:00100000:1.0:1788612713.975083:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932310144 00000100:00100000:1.0:1788612713.975103:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932310144 00000100:00100000:1.0:1788612713.975159:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612713.975171:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:3650:x1875495932310144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612713.975232:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:3650:x1875495932310144:12345-0@lo:400:kworker.0 Request processed in 64us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612713.975240:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612713.975291:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932310656 00000100:00100000:1.0:1788612713.975296:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932310656 00000100:00100000:1.0:1788612713.975322:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612713.975338:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612713.975379:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932310656:12345-0@lo:400:kworker.0 Request processed in 42us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612713.975385:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788612713.975423:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9611c80ece00 x1875495932310656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612713.975436:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932310656:0@lo:400:kworker.0 00000100:00100000:1.0:1788612713.975507:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932310144:0@lo:400:kworker.0 00000100:00100000:3.0:1788612713.981972:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932310272 00000100:00100000:3.0:1788612713.981990:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932310272 00000100:00100000:0.0:1788612713.985862:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612713.985876:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932310272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788612713.985898:0:17203:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788612714.023017:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932310272:12345-0@lo:38:kworker.0 Request processed in 37131us (48208us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612714.023032:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788612714.023087:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612714.023092:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612714.023096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932310272:0@lo:38:kworker.0 00010000:00010000:0.0:1788612714.418375:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612714.863616:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612715.446390:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612715.824138:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788612715.894252:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788612716.463798:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612716.911562:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612717.489649:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612717.936540:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00000020:01000004:1.0:1788612718.213728:0:17930:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612718.213732:0:17930:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788612718.213733:0:17930:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788612718.213961:0:17930:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9612c82bd800 00000020:01000004:1.0:1788612718.213979:0:17930:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788612718.213990:0:17930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788612718.214005:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9612d1e64d40) 00000020:00000080:1.0:1788612718.214022:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788612718.341603:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788612718.345888:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788612718.349984:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788612718.350596:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788612718.351405:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788612718.352557:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788612718.352918:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788612718.353108:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788612718.353589:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788612718.353838:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788612718.354029:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788612718.354634:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788612718.354913:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788612718.355364:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788612718.358462:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.359591:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.360239:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.360700:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.361669:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.362003:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.362566:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.365004:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.367961:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.369986:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.372366:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.372941:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.373336:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.373929:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.375099:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.376215:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.377450:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.378008:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788612718.379449:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788612718.381310:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.385988:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.386417:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.386735:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788612718.387333:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.388585:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788612718.388916:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788612718.389506:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.390106:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788612718.390971:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.391420:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788612718.391829:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788612718.392187:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00080000:01000000:2.0:1788612718.398287:0:17930:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788612718.398582:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788612718.398594:0:17930:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612718.398606:0:17930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc91d3 00000020:01000004:2.0:1788612718.400093:0:17930:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788612718.400122:0:17930:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788612718.400126:0:17930:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788612718.400134:0:17930:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788612718.400276:0:17930:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788612718.400281:0:17930:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788612718.419113:0:17930:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788612718.419364:0:17930:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788612718.419369:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788612718.419719:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788612718.419720:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612718.419721:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612718.419723:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612718.419724:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612718.419725:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612718.419727:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612718.419728:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612718.419732:0:17930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788612718.419734:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612718.419735:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788612718.419737:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612718.419738:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612718.419739:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612718.419740:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612718.419741:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612718.419742:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612718.419743:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612718.419783:0:17930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788612718.419803:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932310784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612718.419874:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.419976:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788612718.425170:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932310784 00000100:00100000:0.0:1788612718.425185:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932310784 00000100:00100000:0.0:1788612718.425242:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612718.425252:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17930:x1875495932310784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788612718.425291:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788612718.425295:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788612718.425303:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788612718.425999:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17930:x1875495932310784:12345-0@lo:253:mount.lustre.0 Request processed in 746us (6122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612718.426009:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612718.426102:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932310784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788612718.426116:0:17930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788612718.426120:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612718.426121:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788612718.426123:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612718.426124:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612718.426126:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612718.426127:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612718.426128:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612718.426130:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612718.426131:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788612718.426173:0:17930:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9612c82bd800 from lustre-MDT0001 10000000:01000000:3.0:1788612718.426204:0:17930:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788612718.426207:0:17930:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788612718.426214:0:17930:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9611c5a23380 local copy 00010000:00010000:3.0:1788612718.426224:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612718.426322:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932310912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612718.426361:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.426410:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.427075:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932310912 00000100:00100000:1.0:1788612718.427082:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932310912 00000100:00100000:1.0:1788612718.427135:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612718.427153:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17930:x1875495932310912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612718.427242:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17930:x1875495932310912:12345-0@lo:501:mount.lustre.0 Request processed in 99us (881us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612718.427250:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612718.427397:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932310912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788612718.427416:0:17930:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788612718.427439:0:17930:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788612718.427446:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.427455:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612718.427516:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612c82bd800 10000000:01000000:2.0:1788612718.427521:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788612718.427526:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9611c5a23380 10000000:01000000:2.0:1788612718.427529:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788612718.427532:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9611c5a23380 from 1 10000000:01000000:2.0:1788612718.427535:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788612718.427563:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.427578:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.427599:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612718.427615:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612718.427646:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.427666:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.427874:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311040 00000100:00100000:3.0:1788612718.427880:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311040 00000100:00100000:3.0:1788612718.427903:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612718.427909:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+12:17930:x1875495932311040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612718.427918:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612718.427930:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc91e1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc91da expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.427951:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc91e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc91da expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.427972:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc91e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc91da expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.427982:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240c00, rc 0) 00000100:00100000:3.0:1788612718.428012:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+13:17930:x1875495932311040:12345-0@lo:101:mount.lustre.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.428018:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612718.428400:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612718.428415:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.428424:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612718.428439:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788612718.428455:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.428462:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612718.428469:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9612c82bd800 10000000:01000000:2.0:1788612718.428513:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788612718.428518:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9612c82bd800 from 1 10000000:01000000:2.0:1788612718.428520:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788612718.428537:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.428544:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.428561:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612718.428585:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612718.428616:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.428639:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.428927:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311168 00000100:00100000:3.0:1788612718.428938:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311168 00000100:00100000:3.0:1788612718.428981:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612718.428989:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+13:17930:x1875495932311168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612718.428999:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612718.429010:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc91ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc91e8 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.429024:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc91ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc91e8 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.429033:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc91ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc91e8 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.429039:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240600, rc 0) 00000100:00100000:3.0:1788612718.429075:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+14:17930:x1875495932311168:12345-0@lo:101:mount.lustre.0 Request processed in 87us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.429081:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612718.429329:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612718.429342:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.429350:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612718.429362:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788612718.429561:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.429578:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612718.429586:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788612718.429590:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612718.429595:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9612c82bd800 10000000:01000000:2.0:1788612718.429598:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788612718.429601:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788612718.429603:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788612718.429620:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.429635:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.429643:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612718.429657:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612718.429686:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.429705:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612718.429792:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311296 00000100:00100000:0.0:1788612718.429796:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311296 00000100:00100000:0.0:1788612718.429838:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612718.429846:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+14:17930:x1875495932311296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612718.429854:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612718.429864:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2896200/0x1f8616bf0bc91fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc91f6 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.429880:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896200/0x1f8616bf0bc91fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc91f6 expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.429889:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2896200/0x1f8616bf0bc91fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc91f6 expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.429895:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896200, rc 0) 00000100:00100000:0.0:1788612718.429937:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311296:12345-0@lo:101:mount.lustre.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612718.429943:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612718.430104:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612718.430115:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.430123:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612718.436735:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788612718.439405:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612718.445701:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788612718.445762:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788612718.445778:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788612718.445793:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788612718.445806:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788612718.445819:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788612718.445835:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788612718.445849:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788612718.445862:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788612718.445876:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788612718.445889:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788612718.445916:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788612718.445930:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788612718.445943:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788612718.445957:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788612718.446057:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788612718.446072:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788612718.446084:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788612718.446097:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788612718.446111:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788612718.446123:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788612718.446137:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788612718.446227:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788612718.446261:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788612718.446267:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788612718.448064:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612718.448140:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.449196:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.452353:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311424 00000100:00100000:1.0:1788612718.452622:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311424 00000100:00100000:0.0:1788612718.456430:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788612718.456444:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612718.456680:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311424:12345-0@lo:501:mount.lustre.0 Request processed in 237us (8538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612718.456688:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788612718.456901:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612718.456956:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612718.457017:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.457044:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.459360:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311552 00000100:00100000:1.0:1788612718.459386:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311552 00000100:00100000:1.0:1788612718.459455:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612718.459466:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612718.460991:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311552:12345-0@lo:503:mount.lustre.0 Request processed in 1522us (3968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.461004:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612718.461128:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311552:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612718.461641:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612718.461729:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.461777:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.461808:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.461879:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311680 00000100:00100000:2.0:1788612718.461885:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311680 00000100:00100000:2.0:1788612718.461918:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788612718.461926:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612718.462973:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311680:12345-0@lo:502:mount.lustre.0 Request processed in 1044us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.462984:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612718.463071:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612718.463359:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788612718.463451:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788612718.463466:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788612718.464250:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788612718.464278:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788612718.464295:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788612718.464312:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788612718.464326:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788612718.464338:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788612718.464349:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788612718.464362:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788612718.464666:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788612718.464688:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788612718.464701:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788612718.464714:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788612718.464726:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788612718.464738:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788612718.464751:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788612718.464764:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788612718.464776:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788612718.464789:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788612718.464801:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788612718.464813:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788612718.464826:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788612718.464839:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788612718.464850:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788612718.464861:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788612718.464873:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788612718.464888:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788612718.464900:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788612718.464912:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788612718.464924:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788612718.464951:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788612718.464966:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788612718.464979:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788612718.464992:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788612718.465005:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788612718.465019:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788612718.465032:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788612718.465045:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788612718.465057:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788612718.465070:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788612718.465082:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788612718.465094:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788612718.465136:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.467816:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.467869:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.468242:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311808 00000100:00100000:1.0:1788612718.468251:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311808 00000100:00100000:1.0:1788612718.468306:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612718.468316:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612718.468713:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932311808:12345-0@lo:502:mount.lustre.0 Request processed in 398us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.468721:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612718.468840:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932311808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612718.468915:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788612718.468929:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788612718.478909:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612718.478925:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.478927:0:17934:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788612718.478933:0:17934:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788612718.478937:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612718.478953:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9612ea24b380) 00000020:00000080:3.0:1788612718.478976:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788612718.478984:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788612718.479087:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788612718.479095:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc920b 00000020:00000080:3.0:1788612718.479323:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788612718.479328:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612718.479332:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.479339:0:17934:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788612718.479342:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612718.479346:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.479348:0:17934:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788612718.479351:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612718.479358:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9612ea2499c0) 00000020:00000080:3.0:1788612718.479604:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788612718.479611:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788612718.479613:0:17934:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788612718.479616:0:17934:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788612718.479622:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788612718.479672:0:17934:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612c82bd800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788612718.479684:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9612ea248000) 00000020:00000080:3.0:1788612718.479694:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788612718.479776:0:17934:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788612718.479782:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9220 00000020:00000080:3.0:1788612718.479878:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788612718.479885:0:17934:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788612718.479889:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1f8616bf0bc9227 00080000:01000000:3.0:1788612718.479894:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788612718.479897:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc922e 00010000:00010000:0.0:1788612718.512716:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612718.589397:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788612718.590602:0:17934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788612718.591025:0:17934:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788612718.592465:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788612718.592506:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612718.592513:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.592516:0:17934:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788612718.592520:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612718.592526:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.592529:0:17934:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788612718.592535:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612718.592540:0:17934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:3.0:1788612718.592581:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612718.592605:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9611c64b99c0) 00000020:00000080:3.0:1788612718.592633:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788612718.592638:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612718.592735:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788612718.592744:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788612718.592753:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc923c 00010000:00080000:3.0:1788612718.592788:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c68fe000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612718.599643:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788612718.601631:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788612718.601699:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788612718.601776:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788612718.601809:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9243 00000100:00080000:2.0:1788612718.601830:0:17934:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612718.601838:0:17934:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9611c68fe000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612718.601887:0:17934:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7b4f800 x1875495932311936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612718.601918:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788612718.601996:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932311936:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788612718.602016:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.602026:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.602028:0:17934:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788612718.602033:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788612718.602037:0:17934:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788612718.602039:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612718.602042:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612718.602044:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788612718.602048:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.602050:0:17934:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788612718.602053:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612718.602059:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.602061:0:17934:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788612718.602066:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788612718.602087:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:2.0:1788612718.602110:0:17934:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788612718.602133:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.602139:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.602141:0:17934:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788612718.602144:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788612718.602146:0:17934:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788612718.602147:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612718.602149:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612718.602151:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788612718.602155:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.602157:0:17934:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788612718.602161:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788612718.602165:0:17934:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788612718.602170:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.602178:0:17934:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788612718.602184:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00100000:0.0:1788612718.602187:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932311936 00000020:00000080:2.0:1788612718.602192:0:17934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000100:00100000:0.0:1788612718.602198:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932311936 00000020:01000000:2.0:1788612718.602227:0:17934:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788612718.602232:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1788612718.602242:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:2.0:1788612718.602249:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9612fcfc3380) 00000100:00100000:0.0:1788612718.602251:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932311936:12345-0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788612718.602268:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788612718.602280:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00010000:00080000:0.0:1788612718.602296:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:0.0:1788612718.602348:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9251 00000004:00100000:0.0:1788612718.602362:0:17204:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788612718.602368:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:2.0:1788612718.602651:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788612718.602663:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788612718.602673:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9258 00010000:00080000:2.0:1788612718.602721:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c78b1000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00000100:00080000:3.0:1788612718.602816:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612718.602823:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788612718.602827:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612718.602835:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1788612718.602843:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788612718.602852:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612f7afa800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612718.602887:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed59500 x1875495932312064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612718.602913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612718.602918:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612718.602922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612718.602926:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788612718.602979:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932312192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612718.603043:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612718.603068:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788612718.603153:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932312192 00000100:00100000:0.0:1788612718.603160:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932312192 00000100:00100000:0.0:1788612718.603212:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612718.603224:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932312192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612718.603282:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932312192:12345-0@lo:400:kworker.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612718.603289:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612718.603332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fed5a300 x1875495932312192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612718.603345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932312192:0@lo:400:kworker.0 00000100:00100000:0.0:1788612718.603387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932312064:0@lo:38:kworker.0 00000100:00100000:0.0:1788612718.603426:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.603471:0:17203:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788612718.603499:0:17203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788612718.603665:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932312064 00000100:00100000:0.0:1788612718.603671:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932312064 00000100:00100000:0.0:1788612718.603809:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612718.603815:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875495932312064:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788612718.603860:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875495932312064:12345-0@lo:38:kworker.0 Request processed in 44us (434us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788612718.603867:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612718.603888:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612718.603901:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612718.603905:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788612718.603908:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932312064:0@lo:38:kworker.0 00000040:01000000:1.0:1788612718.610533:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788612718.611028:0:17934:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788612718.618589:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612718.619923:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788612718.620119:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788612718.624249:0:17940:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788612718.624257:0:17940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788612718.625175:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788612718.625188:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788612718.625228:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788612718.625252:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc925f 00000100:00080000:1.0:1788612718.625262:0:17934:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612718.625269:0:17934:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9611c78b1000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612718.625307:0:17934:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80eed80 x1875495932312320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612718.625339:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788612718.625416:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612718.625421:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612718.625423:0:17934:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788612718.625426:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788612718.625429:0:17934:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788612718.625430:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788612718.625432:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788612718.625433:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788612718.625436:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612718.625437:0:17934:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788612718.625440:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788612718.625443:0:17934:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788612718.625446:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612718.625448:0:17934:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788612718.625451:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788612718.625454:0:17934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1788612718.625711:0:17934:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788612718.625715:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612718.625728:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9612d1e619c0) 00000020:00000080:1.0:1788612718.625742:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788612718.625747:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788612718.625829:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788612718.625837:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788612718.625843:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc926d 00010000:00080000:1.0:1788612718.625877:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612fccfd800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788612718.626071:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788612718.626133:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788612718.626147:0:17934:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788612718.626809:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612718.626814:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788612718.626817:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612718.626826:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612f7afa800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612718.626850:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed59c00 x1875495932312576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612718.626862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612718.626865:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612718.626868:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612718.626871:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612718.626887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612718.626890:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612718.627338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932312320:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788612718.627408:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932312320 offset 0 length 520: 4 00000100:00100000:2.0:1788612718.627444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932312576:0@lo:38:kworker.0 00000100:00100000:2.0:1788612718.627470:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.627758:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932312576 00000100:00100000:2.0:1788612718.627766:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932312576 00000100:00100000:2.0:1788612718.627805:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612718.627813:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932312576:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788612718.627865:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932312576:12345-0@lo:38:kworker.0 Request processed in 52us (394us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788612718.627873:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612718.627895:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612718.627904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932312448:0@lo:400:kworker.0 00000100:00100000:2.0:1788612718.627944:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.627975:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932312448 00000100:00100000:2.0:1788612718.627979:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932312448 00000100:00100000:2.0:1788612718.628010:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788612718.628017:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:3648:x1875495932312448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612718.628056:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:3648:x1875495932312448:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.628063:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788612718.628102:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932312448:0@lo:400:kworker.0 00000100:00080000:2.0:1788612718.628131:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612718.628135:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788612718.628138:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932312576:0@lo:38:kworker.0 00000100:00100000:1.0:1788612718.628306:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932312704:0@lo:400:kworker.0 00000100:00100000:1.0:1788612718.628341:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612718.630267:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932312704 00000100:00100000:1.0:1788612718.630294:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932312704 00000100:00100000:1.0:1788612718.630346:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612718.630354:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932312704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612718.634639:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932312704:12345-0@lo:400:kworker.0 Request processed in 4278us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.634654:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788612718.636269:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9612c7662800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612718.636347:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932311936:12345-0@lo:38:llog_process_th.0 Request processed in 34095us (34262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612718.636357:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612718.636904:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612718.636914:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788612718.636922:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788612718.636928:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612718.636930:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c68fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612718.636949:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932311936:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788612718.637258:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fed59500 x1875495932312704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612718.637270:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932312704:0@lo:400:kworker.0 00000100:00100000:2.0:1788612718.637285:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612718.637294:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932312832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612718.637337:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.637387:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932312832 00000100:00100000:2.0:1788612718.637393:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932312832 00000100:00100000:2.0:1788612718.637430:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612718.637438:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932312832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612718.637463:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788612718.637519:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932312832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.637536:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612718.637582:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932312832:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788612718.637870:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612718.643680:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788612718.643835:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788612718.645230:0:17942:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788612718.645237:0:17942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788612718.646248:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788612718.646260:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788612718.646301:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788612718.646323:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9274 00000100:00080000:2.0:1788612718.646334:0:17934:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612718.646340:0:17934:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612fccfd800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612718.646738:0:17934:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7b4f480 x1875495932312960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612718.646757:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788612718.646842:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932312960:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788612718.646896:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932312960 offset 0 length 520: 4 00000020:01000000:2.0:1788612718.647006:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.647010:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.647012:0:17934:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788612718.647015:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612718.647020:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.647021:0:17934:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612718.647024:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612718.647026:0:17934:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612718.647028:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.647031:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.647032:0:17934:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612718.647034:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612718.647036:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.647038:0:17934:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612718.647041:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788612718.647069:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.647072:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.647073:0:17934:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788612718.647077:0:17934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:2.0:1788612718.651966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612718.651975:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612718.651978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612718.651981:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788612718.652165:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788612718.652209:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788612718.652232:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.652244:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612718.652252:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c82bd800 from 1 10000000:01000000:0.0:1788612718.652271:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612718.652310:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.652318:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.652328:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612718.652351:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612718.652772:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.652846:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.654175:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313088 00000100:00100000:1.0:1788612718.654187:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313088 00000100:00100000:1.0:1788612718.654281:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612718.654291:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+15:17930:x1875495932313088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612718.654305:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612718.654322:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc927b expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.654348:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.654359:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.654368:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799bc00, rc 0) 00000100:00100000:1.0:1788612718.654623:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:17930:x1875495932313088:12345-0@lo:101:mount.lustre.0 Request processed in 333us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.654630:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788612718.654716:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612718.654734:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.654745:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612718.655265:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313216:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788612718.655309:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.658133:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.658272:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313216 00000100:00100000:2.0:1788612718.658281:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313216 00000100:00100000:2.0:1788612718.658331:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612718.658343:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:17930:x1875495932313216:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788612718.658365:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788612718.658407:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788612718.658412:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788612718.658542:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:17930:x1875495932313216:12345-0@lo:256:mount.lustre.0 Request processed in 202us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.658550:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788612718.658777:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313216:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788612718.659346:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612718.659509:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.659532:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612718.659540:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c82bd800 from 1 10000000:01000000:0.0:1788612718.659543:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612718.659584:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.659592:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.659601:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612718.659622:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612718.659665:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.659691:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.659764:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313344 00000100:00100000:2.0:1788612718.659770:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313344 00000100:00100000:2.0:1788612718.659798:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612718.659805:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:17930:x1875495932313344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612718.659814:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612718.659827:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9289 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.659847:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.659857:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612718.659878:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36e00, rc 0) 00000100:00100000:2.0:1788612718.659917:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313344:12345-0@lo:101:mount.lustre.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.659923:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788612718.660034:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612718.660047:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612718.660056:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612718.660177:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612718.660205:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612718.660231:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.660265:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.663870:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313472 00000100:00100000:2.0:1788612718.663884:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313472 00000100:00100000:2.0:1788612718.663934:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612718.663945:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612718.664123:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313472:12345-0@lo:501:mount.lustre.0 Request processed in 180us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.664131:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612718.664668:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612718.664721:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612718.664779:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.664816:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.664869:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313600 00000100:00100000:2.0:1788612718.664875:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313600 00000100:00100000:2.0:1788612718.664898:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612718.664905:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612718.664993:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313600:12345-0@lo:503:mount.lustre.0 Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.665000:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788612718.665072:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788612718.665591:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612718.665667:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612718.665706:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.665726:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.665783:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313728 00000100:00100000:2.0:1788612718.665787:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313728 00000100:00100000:2.0:1788612718.665808:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788612718.665814:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612718.665897:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313728:12345-0@lo:502:mount.lustre.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.665904:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788612718.666257:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612718.666934:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788612718.666964:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788612718.666977:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788612718.666989:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788612718.667001:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788612718.667013:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788612718.667041:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788612718.667057:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788612718.667070:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788612718.667083:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788612718.667095:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788612718.667123:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612718.667174:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612718.667244:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.667853:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313856 00000100:00100000:1.0:1788612718.667861:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313856 00000100:00100000:2.0:1788612718.671520:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612718.671546:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612718.671729:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313856:12345-0@lo:502:mount.lustre.0 Request processed in 195us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.671737:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788612718.671880:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612718.671964:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788612718.671985:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788612718.674734:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612718.674747:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.674750:0:17944:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612718.674758:0:17944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612c82bd800 00000020:00000080:3.0:1788612718.674760:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612718.674769:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612718.674772:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.674773:0:17944:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788612718.674776:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612718.674778:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.674779:0:17944:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788612718.674782:0:17944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612c82bd800 00000020:00000080:3.0:1788612718.674785:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612718.674873:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612718.674878:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.674879:0:17944:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788612718.674881:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612718.674884:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612718.674885:0:17944:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612718.674888:0:17944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612c82bd800 00000020:00000080:3.0:1788612718.674902:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612718.683811:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.683905:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.683909:0:17944:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788612718.683914:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612718.683919:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.683920:0:17944:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788612718.683926:0:17944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612c82bd800 00000020:00000080:2.0:1788612718.683928:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612718.684008:0:17944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612718.684012:0:17944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612718.684013:0:17944:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788612718.684017:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788612718.684189:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788612718.684221:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612718.684246:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.684258:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612718.684314:0:17930:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788612718.684318:0:17930:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612c82bd800 10000000:01000000:3.0:1788612718.684321:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612c82bd800 10000000:01000000:3.0:1788612718.684325:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612718.684331:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612c82bd800 from 1 10000000:01000000:3.0:1788612718.684333:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612718.684371:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.684582:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.684594:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612718.684616:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612718.684680:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.684909:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c901d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.688842:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932313984 00000100:00100000:2.0:1788612718.688857:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932313984 00000100:00100000:1.0:1788612718.712696:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788612718.712710:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17930:x1875495932313984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612718.712727:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612718.712749:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799b600/0x1f8616bf0bc929e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9297 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.712777:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799b600/0x1f8616bf0bc929e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9297 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.712788:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799b600/0x1f8616bf0bc929e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9297 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.712797:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b600, rc 0) 00000100:00100000:1.0:1788612718.712870:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932313984:12345-0@lo:101:mount.lustre.0 Request processed in 163us (28190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.712877:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612718.714577:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932313984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612718.714606:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.714625:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612718.715734:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788612718.715989:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612718.716141:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788612718.716165:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788612718.716178:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788612718.716190:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788612718.716218:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788612718.716233:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788612718.716244:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788612718.716255:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788612718.716265:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788612718.716276:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788612718.716287:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788612718.716299:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788612718.716310:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788612718.716322:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788612718.716334:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788612718.716347:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788612718.716358:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788612718.716369:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788612718.718560:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788612718.718620:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788612718.718652:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788612718.718667:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788612718.718680:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788612718.718694:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788612718.718707:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788612718.718719:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788612718.718744:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788612718.718759:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788612718.718783:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788612718.718788:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788612718.718888:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612718.718949:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.720085:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612718.724979:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314112 00000100:00100000:2.0:1788612718.724995:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314112 00000100:00100000:2.0:1788612718.725052:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788612718.725063:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612718.725233:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314112:12345-0@lo:501:mount.lustre.0 Request processed in 171us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612718.725241:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612718.725326:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612718.725386:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612718.725432:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.725467:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.725517:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314240 00000100:00100000:3.0:1788612718.725522:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314240 00000100:00100000:3.0:1788612718.725547:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612718.725554:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612718.725640:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314240:12345-0@lo:503:mount.lustre.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.725647:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612718.725688:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314240:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612718.726068:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612718.726130:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.726169:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.726187:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1fe8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.726202:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314368 00000100:00100000:3.0:1788612718.726206:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314368 00000100:00100000:3.0:1788612718.726232:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612718.726238:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.726320:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314368:12345-0@lo:502:mount.lustre.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.726327:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612718.726361:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612718.726532:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788612718.726555:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788612718.726582:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788612718.726597:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788612718.726609:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788612718.726631:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788612718.726644:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788612718.726655:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788612718.726666:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788612718.726677:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788612718.726690:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788612718.726702:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788612718.726713:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788612718.726726:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788612718.726739:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788612718.726752:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788612718.726768:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788612718.726780:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788612718.726793:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788612718.726806:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788612718.726819:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788612718.726845:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788612718.726865:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788612718.726879:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788612718.726892:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788612718.726904:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788612718.726927:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788612718.726941:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788612718.726953:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788612718.726965:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788612718.726977:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788612718.726991:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788612718.727004:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788612718.727016:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788612718.727030:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788612718.727042:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788612718.727054:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788612718.727079:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788612718.727094:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788612718.727105:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788612718.727115:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788612718.727127:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788612718.727139:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788612718.727152:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788612718.727165:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788612718.727176:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788612718.727188:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788612718.727201:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788612718.727235:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.727280:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.727301:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.727322:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314496 00000100:00100000:3.0:1788612718.727326:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314496 00000100:00100000:3.0:1788612718.727356:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612718.727363:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.727437:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314496:12345-0@lo:502:mount.lustre.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.727451:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612718.727515:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612718.727661:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788612718.727682:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788612718.727702:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.727736:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.727751:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1fe8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.727765:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314624 00000100:00100000:3.0:1788612718.727768:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314624 00000100:00100000:3.0:1788612718.727789:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612718.727794:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612718.727859:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314624:12345-0@lo:502:mount.lustre.0 Request processed in 64us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.727864:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612718.727902:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612718.727935:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788612718.727943:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788612718.736060:0:17949:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788612718.736076:0:17949:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9611c69d19c0) 00000020:00000080:0.0:1788612718.736099:0:17949:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788612718.736193:0:17949:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612c82bd800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788612718.736197:0:17949:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612c82bd800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788612718.736200:0:17949:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612c82bd800 3 00010000:00080000:0.0:1788612718.736230:0:17949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c8053000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612718.748793:0:17949:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788612718.749015:0:17949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788612718.749061:0:17949:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612718.749074:0:17949:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1f8616bf0bc92ac 00000100:00080000:0.0:1788612718.749084:0:17949:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612718.749091:0:17949:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9611c8053000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612718.749126:0:17949:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79ab480 x1875495932314752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612718.749155:0:17949:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788612718.750877:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932314752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788612718.750954:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.751132:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314752 00000100:00100000:3.0:1788612718.751140:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314752 00000100:00100000:3.0:1788612718.751175:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612718.751182:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932314752:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788612718.751207:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788612718.751241:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1f8616bf0bc92b3 00000004:00100000:3.0:1788612718.751261:0:17199:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612718.751294:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9611c68f9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612718.751344:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875495932314752:12345-0@lo:38:llog_process_th.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.751352:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788612718.753631:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9611c79ab480 x1875495932314752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612718.753645:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612718.753655:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788612718.753663:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788612718.753669:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612718.753671:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c8053000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612718.753677:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932314752:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788612718.754330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612718.754336:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612718.754339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612718.754341:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788612718.754690:0:17949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788612718.755109:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788612718.755141:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612718.755167:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.755178:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788612718.755226:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788612718.755229:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788612718.755230:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612718.755231:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612718.755232:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612718.755233:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612718.755234:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612718.755236:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612718.755242:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612718.755245:0:17930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788612718.755247:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612718.755248:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788612718.755249:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612718.755250:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612718.755250:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612718.755251:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612718.755252:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612718.755253:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612718.755254:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612718.755275:0:17930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788612718.755292:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314880:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612718.755354:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.756633:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612718.756661:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932314880 00000100:00100000:3.0:1788612718.756669:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932314880 00000100:00100000:3.0:1788612718.756719:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612718.756728:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612718.756757:0:17191:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788612718.756771:0:17191:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788612718.758936:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788612718.759000:0:17191:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788612718.759018:0:17191:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788612718.759288:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17930:x1875495932314880:12345-0@lo:253:mount.lustre.0 Request processed in 2556us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612718.759299:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612718.759361:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:17930:1875495932314880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612718.759391:0:17930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788612718.759395:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612718.759396:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788612718.759397:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612718.759399:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612718.759409:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612718.759410:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612718.759412:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612718.759414:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612718.759415:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788612718.759430:0:17930:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788612718.763000:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788612718.763008:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788612718.763031:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763049:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763073:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763080:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763117:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763133:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 17 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612718.763148:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932315008:0@lo:104: 00000100:00100000:1.0:1788612718.763205:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612718.763259:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763268:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 17 pid: 17191 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612718.763277:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932315136:0@lo:104: 00000100:00100000:1.0:1788612718.763297:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612718.763317:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1282900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.763338:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315008 00000100:00100000:1.0:1788612718.763345:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315008 00000100:00100000:1.0:1788612718.763388:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315136 00000100:00100000:1.0:1788612718.763391:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315136 00000100:00100000:1.0:1788612718.763406:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612718.763414:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:17214:x1875495932315008:12345-0@lo:104: 00010000:00010000:1.0:1788612718.763431:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763499:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612718.763505:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:17214:x1875495932315008:12345-0@lo:104: Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.763512:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612718.763528:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612718.763534:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932315136:12345-0@lo:104: 00010000:00010000:1.0:1788612718.763543:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763588:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612718.763594:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932315136:12345-0@lo:104: Request processed in 61us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.763599:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612718.763627:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932315008:0@lo:104: 00000100:00100000:1.0:1788612718.763636:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932315136:0@lo:104: 00010000:00010000:1.0:1788612718.763652:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763668:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612718.763673:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763679:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612718.763683:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763697:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612718.763704:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612718.763710:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612718.763735:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763742:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612718.763761:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763768:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896600/0x1f8616bf0bc927b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9282 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763780:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612718.763783:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763788:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612718.763790:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763796:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612718.763802:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612718.763812:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612718.763828:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763833:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612718.763840:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763846:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b36c00/0x1f8616bf0bc91b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc91be expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.763857:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612718.763859:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612718.763860:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612718.763877:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932315264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612718.763904:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612718.763926:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612718.763931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932315392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612718.763949:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.767720:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315264 00000100:00100000:3.0:1788612718.767733:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315264 00010000:00010000:3.0:1788612718.767776:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 18 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612718.767808:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315392 00000100:00100000:3.0:1788612718.767811:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315392 00010000:00010000:3.0:1788612718.767822:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 19 pid: 17191 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612718.767834:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612718.767841:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:3648:x1875495932315264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612718.767866:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612718.767870:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 19 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.767882:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 19 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.767896:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc927b expref: 19 pid: 17193 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.767910:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612718.767972:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3648:x1875495932315264:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.767979:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612718.767998:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612718.768005:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:3648:x1875495932315392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612718.768012:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612718.768016:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 17 pid: 17191 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768025:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 17 pid: 17191 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768034:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799a600/0x1f8616bf0bc91be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc91b7 expref: 17 pid: 17191 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768045:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768054:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612718.768075:0:17183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005067850s 00010000:00010000:3.0:1788612718.768079:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768086:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768093:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768101:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768107:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612718.768111:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768118:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768130:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612718.768139:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612718.768163:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:3648:x1875495932315392:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (4213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612718.768170:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788612718.768189:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612718.770024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932315392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612718.770039:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932315264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612718.770068:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.770079:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612718.770096:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc92ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788612718.781135:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788612718.781400:0:17956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788612718.781690:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788612718.782008:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612718.784057:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788612718.784134:0:17956:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:2.0:1788612718.784946:0:17955:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788612718.784951:0:17955:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788612718.785340:0:17957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17957:1875495932315520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788612718.785426:0:17957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612718.785471:0:17957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.785868:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315520 00000100:00100000:1.0:1788612718.785876:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315520 00000100:00100000:1.0:1788612718.785974:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612718.785985:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17957:x1875495932315520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788612718.786077:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17957:x1875495932315520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.786085:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612718.786177:0:17957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17957:1875495932315520:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788612718.786208:0:17957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788612718.786239:0:17957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17957:1875495932315648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612718.786274:0:17957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.786303:0:17957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.786840:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315648 00000100:00100000:1.0:1788612718.786847:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315648 00000100:00100000:1.0:1788612718.786879:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612718.786887:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17957:x1875495932315648:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788612718.787010:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17957:x1875495932315648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 123us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.787017:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612718.787083:0:17957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17957:1875495932315648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612718.787144:0:17957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17957:1875495932315776:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788612718.787172:0:17957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.787199:0:17957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612718.787325:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315776 00000100:00100000:1.0:1788612718.787329:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315776 00000100:00100000:1.0:1788612718.787365:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612718.787464:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17957:x1875495932315776:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788612718.787631:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17957:x1875495932315776:12345-0@lo:900:lod0001_rec0000.0 Request processed in 259us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.787639:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788612718.790086:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788612718.790132:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788612718.790935:0:17930:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788612718.790961:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788612718.791009:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612718.793225:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788612718.793834:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788612718.793871:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788612718.794047:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788612718.794536:0:17930:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00010000:00080000:3.0:1788612718.797857:0:17957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fed58380 x1875495932315776/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612734 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612718.797876:0:17957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17957:1875495932315776:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788612718.798034:0:17957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17957:1875495932315904:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612718.798097:0:17957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612718.798943:0:17957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d480 going to sleep for 11 seconds 00000001:00000004:0.0:1788612718.806252:0:17930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788612718.806428:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932315904 00000100:00100000:1.0:1788612718.806436:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932315904 00000100:00100000:1.0:1788612718.806503:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612718.806513:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17957:x1875495932315904:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788612718.806637:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17957:x1875495932315904:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (8539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612718.806644:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612718.811007:0:17957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17957:1875495932315904:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788612718.811079:0:17957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612718.815872:0:17957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788612718.815953:0:17957:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788612718.815959:0:17957:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788612718.816194:0:17930:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788612718.816223:0:17930:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9b941c47988 00100000:10000000:1.0:1788612718.816231:0:17930:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788612718.818417:0:17930:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788612718.818449:0:17930:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788612718.818470:0:17930:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788612718.818520:0:17930:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788612718.820057:0:17930:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612718.820257:0:17930:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788612718.969235:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612719.537959:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612719.793166:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788612719.984587:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 10000000:01000000:2.0:1788612720.176577:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788612720.176585:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c82bd800 from 8 10000000:01000000:2.0:1788612720.176590:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788612720.176638:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.176651:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.176661:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612720.176686:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612720.176767:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612720.176820:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54540 going to sleep for 11 seconds 00000100:00100000:1.0:1788612720.177088:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316032 00000100:00100000:1.0:1788612720.177096:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316032 00000100:00100000:1.0:1788612720.177154:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788612720.177163:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:17195:x1875495932316032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612720.177175:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612720.177189:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc92c1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612720.177213:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612720.177223:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612720.177231:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799bc00, rc 0) 00000100:00100000:1.0:1788612720.177282:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932316032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612720.177288:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788612720.177698:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612720.177714:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.177723:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612720.177779:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788612720.177813:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612720.177841:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54540 going to sleep for 11 seconds 00000100:00100000:0.0:1788612720.177895:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316160 00000100:00100000:0.0:1788612720.177900:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316160 00000100:00100000:0.0:1788612720.177930:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612720.177936:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932316160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788612720.177961:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612720.177978:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612720.177981:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788612720.178066:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932316160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612720.178081:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788612720.178544:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788612720.178605:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612720.178613:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.178626:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612720.178635:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788612720.178637:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c816d000 from 8 10000000:01000000:2.0:1788612720.178639:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788612720.178661:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.178668:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.178676:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612720.178691:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612720.178720:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612720.178759:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612720.178876:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316288 00000100:00100000:3.0:1788612720.178881:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316288 00000100:00100000:3.0:1788612720.178922:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612720.178931:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932316288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612720.178939:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612720.178961:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc92cf expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612720.178979:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612720.178988:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612720.178995:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240200, rc 0) 00000100:00100000:3.0:1788612720.179032:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932316288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612720.179038:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788612720.179531:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612720.179545:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.179570:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612720.179620:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788612720.179653:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612720.179677:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612720.179890:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316416 00000100:00100000:3.0:1788612720.179896:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316416 00000100:00100000:3.0:1788612720.179932:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788612720.179940:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932316416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788612720.179964:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612720.179977:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612720.179980:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788612720.180054:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932316416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612720.180061:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612720.180265:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932316416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788612720.180304:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612720.180311:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612720.180320:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612720.561407:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612720.818738:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788612721.011924:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612721.584499:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612722.032151:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788612722.608850:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612723.057138:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788612723.632764:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612723.695950:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612723.695971:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932316544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612723.696043:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612723.699582:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316544 00000100:00100000:2.0:1788612723.699597:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316544 00000100:00100000:2.0:1788612723.699659:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612723.699669:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932316544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612723.699704:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788612723.699796:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932316544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612723.699803:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612723.699848:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932316544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612724.086832:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 0 seconds 00000100:00080000:1.0:1788612724.207708:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788612724.207715:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788612724.207719:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612724.207730:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612f7afa800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612724.207756:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80ef480 x1875495932316800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612724.207773:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612724.207777:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612724.207780:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612724.207783:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612724.207800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612724.207803:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612724.207805:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612724.207809:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612724.207836:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932316800:0@lo:38:kworker.0 00000100:00100000:1.0:1788612724.207901:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612724.207973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932316928:0@lo:400:kworker.0 00000100:00100000:1.0:1788612724.208001:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612724.208020:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612724.208034:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932317056:0@lo:400:kworker.0 00000100:00100000:1.0:1788612724.208064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612724.208099:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316800 00000100:00100000:1.0:1788612724.208106:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316800 00000100:00100000:1.0:1788612724.208136:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612724.208142:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932316800:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788612724.208167:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000100:00100000:2.0:1788612724.208283:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932316672:0@lo:400:kworker.0 00000100:00100000:2.0:1788612724.208323:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612724.208364:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316672 00000100:00100000:2.0:1788612724.208368:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316672 00000100:00100000:2.0:1788612724.208400:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612724.208407:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3651:x1875495932316672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612724.208455:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3651:x1875495932316672:12345-0@lo:400:kworker.0 Request processed in 47us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612724.208506:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612724.208568:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932316672:0@lo:400:kworker.0 00000020:00000080:1.0:1788612724.208740:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc92dd 00000004:00100000:1.0:1788612724.208756:0:17204:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788612724.208761:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788612724.208831:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932316928 00000100:00100000:1.0:1788612724.208836:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932316928 00000100:00100000:1.0:1788612724.208860:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317056 00000100:00100000:1.0:1788612724.208863:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317056 00000100:00100000:1.0:1788612724.208875:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612724.208880:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932316928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612724.208918:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932316928:12345-0@lo:400:kworker.0 Request processed in 36us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612724.208924:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612724.208936:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612724.208941:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932317056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612724.208968:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932317056:12345-0@lo:400:kworker.0 Request processed in 27us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612724.208974:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788612724.209004:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c80ed880 x1875495932317056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612724.209015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932317056:0@lo:400:kworker.0 00010000:00080000:1.0:1788612724.209036:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c80ee300 x1875495932316928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612724.209044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932316928:0@lo:400:kworker.0 00000100:00080000:1.0:1788612724.220629:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9612e92bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612724.220771:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932316800:12345-0@lo:38:kworker.0 Request processed in 12626us (12868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612724.220783:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788612724.233851:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788612724.233867:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788612724.233874:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788612724.233877:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788612724.233896:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007486f70b): req@ffff9611c80ee680 x1875495932309376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612724.233926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932316800:0@lo:38:kworker.0 00000100:00100000:2.0:1788612724.235204:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612724.235252:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fead9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612724.236095:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932309376 00000100:00100000:0.0:1788612724.236107:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932309376 00000100:00100000:0.0:1788612724.236161:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612724.236171:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1875495932309376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788612724.236265:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1875495932309376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612724.236272:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612724.236351:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ee680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1875495932309376:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788612724.236395:0:17240:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788612724.236437:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1875495932317184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788612724.236491:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612724.236519:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612724.236704:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612724.236716:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932317312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612724.236746:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612724.236777:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317184 00000100:00100000:1.0:1788612724.236781:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317184 00000100:00100000:1.0:1788612724.236809:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317312 00000100:00100000:1.0:1788612724.236812:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317312 00000100:00100000:1.0:1788612724.236824:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612724.236830:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17240:x1875495932317184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788612724.236957:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17240:x1875495932317184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 127us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612724.236965:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612724.236982:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1875495932317184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788612724.236982:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612724.236993:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932317312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612724.237015:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612724.237054:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932317312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612724.237061:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612724.237065:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1875495932317440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788612724.237097:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612724.237102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932317312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612724.237116:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a95900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612724.237147:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317440 00000100:00100000:1.0:1788612724.237151:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317440 00000100:00100000:1.0:1788612724.237185:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612724.237192:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1875495932317440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788612724.237246:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1875495932317440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612724.237252:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612724.237284:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1875495932317440:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788612724.237323:0:17240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612724.243672:0:17240:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788612724.243806:0:17240:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1788612724.243812:0:17240:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:2.0:1788612724.480842:0:18200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788612724.656656:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612725.040145:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788612725.557259:0:18252:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612725.559892:0:18252:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612725.679696:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788612726.594401:0:18303:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612726.604010:0:18303:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612726.705991:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788612727.645341:0:18352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdaa472fc0 20000000:00000080:2.0:1788612727.645359:0:18352:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9612e92d0000 uarg=0000000000000000 20000000:01000000:2.0:1788612727.645397:0:18352:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788612727.645409:0:18352:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788612727.645413:0:18352:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788612727.646216:0:18353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788612727.646419:0:18352:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788612727.654920:0:18352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788612727.655034:0:18352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.655058:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.655066:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.655073:0:18352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.655123:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.655141:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 17 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612727.655155:0:18352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875495932317568:0@lo:104: 00000100:00100000:2.0:1788612727.655222:0:18352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612727.655382:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.655393:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 17 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612727.655402:0:18352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875495932317696:0@lo:104: 00000100:00100000:2.0:1788612727.655428:0:18352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612727.655962:0:18352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612727.656073:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317568 00000100:00100000:3.0:1788612727.656081:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317568 00000100:00100000:3.0:1788612727.656116:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317696 00000100:00100000:3.0:1788612727.656119:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317696 00000100:00100000:3.0:1788612727.656133:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612727.656141:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:18352:x1875495932317568:12345-0@lo:104: 00010000:00010000:3.0:1788612727.656154:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656219:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612727.656226:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:18352:x1875495932317568:12345-0@lo:104: Request processed in 86us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612727.656233:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612727.656249:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612727.656256:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:18352:x1875495932317696:12345-0@lo:104: 00010000:00010000:3.0:1788612727.656263:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656294:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788612727.656299:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:18352:x1875495932317696:12345-0@lo:104: Request processed in 44us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612727.656305:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788612727.656337:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612727.656343:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656351:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612727.656355:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656363:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612727.656370:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612727.656376:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612727.656402:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656408:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612727.656424:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656431:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897800/0x1f8616bf0bc9289 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9290 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656443:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612727.656446:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656451:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612727.656454:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656465:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612727.656472:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612727.656519:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612727.656532:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656538:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612727.656551:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656558:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7241200/0x1f8616bf0bc9186 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc918d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656571:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612727.656573:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612727.656574:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612727.656592:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932317824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612727.656624:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612727.656659:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932317952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612727.656682:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612727.656715:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317824 00000100:00100000:3.0:1788612727.656719:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317824 00010000:00010000:3.0:1788612727.656737:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 18 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612727.656769:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932317952 00000100:00100000:3.0:1788612727.656772:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932317952 00010000:00010000:3.0:1788612727.656783:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 19 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612727.656795:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612727.656801:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:3651:x1875495932317824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612727.656812:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612727.656816:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 19 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656826:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 19 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656853:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612727.656883:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:3651:x1875495932317824:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612727.656889:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612727.656902:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612727.656908:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3648:x1875495932317952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612727.656916:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612727.656920:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 18 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656928:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 18 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656939:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656952:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656965:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656972:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656978:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656984:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.656989:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612727.656993:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.657000:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.657007:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.657018:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612727.657045:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3648:x1875495932317952:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612727.657051:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612727.657090:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932317952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612727.657123:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932317824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612727.657360:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612727.657716:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc9290 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9289 expref: 17 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612727.657728:0:18352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875495932317568:0@lo:104: 00010000:00010000:2.0:1788612727.657738:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc918d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9186 expref: 16 pid: 17191 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612727.657746:0:18352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875495932317696:0@lo:104: 00010000:00010000:2.0:1788612727.657764:0:18352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.657773:0:18352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.657779:0:18352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612727.657785:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc92e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612727.727727:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612728.306990:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612718/real 1788612718] req@ffff9611c7b4f480 x1875495932312960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307028:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9611c7b4f480 x1875495932312960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307067:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612718/real 1788612718] req@ffff9611c80eed80 x1875495932312320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307084:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9611c80eed80 x1875495932312320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307094:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612713/real 1788612713] req@ffff9611c80efb80 x1875495932310400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307105:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9611c80efb80 x1875495932310400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307113:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612713/real 1788612713] req@ffff9611c80ef100 x1875495932310528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612728.307124:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9611c80ef100 x1875495932310528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612728 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612728.307144:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612728.307206:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612728.307211:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932312960:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788612728.307217:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612728.316669:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612728.316687:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932312320:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788612728.317130:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612728.317149:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612728.317154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932310400:0@lo:8:kworker.0 00000100:00080000:0.0:1788612728.317190:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612728.317199:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612728.317203:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932310528:0@lo:8:kworker.0 00000100:00080000:3.0:1788612728.318127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612728.318134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788612728.318137:0:36:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612728.318145:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1788612728.318153:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788612728.318161:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff961300767000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612728.318191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed59880 x1875495932318208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612728.318208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612728.318211:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788612728.318213:0:36:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612728.318216:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1788612728.318219:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788612728.318222:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961300767800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612728.318235:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed58e00 x1875495932318336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612728.318286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612728.318289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788612728.318291:0:36:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612728.318296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1788612728.318299:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612728.318303:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9611c78b1000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612728.318327:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed5bb80 x1875495932318720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612728.318337:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612728.318340:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788612728.318342:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612728.318345:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1788612728.318347:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612728.318351:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612fccfd800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612728.318373:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed59500 x1875495932318848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612728.318424:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932318976:0@lo:400:kworker.0 00000100:00100000:3.0:1788612728.318896:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612728.318946:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612728.318954:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932318080:0@lo:400:kworker.0 00000100:00100000:3.0:1788612728.318987:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612728.319025:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932318464:0@lo:400:kworker.0 00000100:00100000:3.0:1788612728.319051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612728.319069:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612728.319074:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932318592:0@lo:400:kworker.0 00000100:00100000:3.0:1788612728.319096:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612728.319135:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932318080 00000100:00100000:3.0:1788612728.319145:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932318080 00000100:00100000:3.0:1788612728.319195:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932318592 00000100:00100000:3.0:1788612728.319198:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932318592 00000100:00100000:3.0:1788612728.319217:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612728.319228:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932318080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612728.319315:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932318080:12345-0@lo:400:kworker.0 Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612728.319323:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612728.319343:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612728.319349:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932318592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612728.321949:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932318208:0@lo:8:kworker.0 00000400:00000100:2.0:1788612728.322077:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932318208 offset 0 length 520: 4 00000100:00100000:2.0:1788612728.322138:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932318336:0@lo:8:kworker.0 00000400:00000100:2.0:1788612728.322158:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932318336 offset 0 length 520: 4 00000100:00100000:2.0:1788612728.322171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932318720:0@lo:8:kworker.0 00000400:00000100:2.0:1788612728.322187:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932318720 offset 0 length 520: 4 00000100:00100000:2.0:1788612728.322196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932318848:0@lo:8:kworker.0 00000400:00000100:2.0:1788612728.322228:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932318848 offset 0 length 520: 4 00000100:00100000:3.0:1788612728.323030:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932318592:12345-0@lo:400:kworker.0 Request processed in 3433us (3685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612728.323045:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612728.323192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932318080:0@lo:400:kworker.0 00000100:00100000:2.0:1788612728.323292:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932318592:0@lo:400:kworker.0 00000100:00100000:1.0:1788612728.323907:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932318976 00000100:00100000:1.0:1788612728.323919:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932318976 00000100:00100000:1.0:1788612728.324018:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932318464 00000100:00100000:1.0:1788612728.324022:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932318464 00000100:00100000:2.0:1788612728.324063:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612728.324076:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932318976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612728.324249:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932318976:12345-0@lo:400:kworker.0 Request processed in 175us (5353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612728.324257:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612728.324276:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612728.324282:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932318464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612728.324317:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932318464:12345-0@lo:400:kworker.0 Request processed in 35us (5265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612728.324324:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788612728.324520:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fed59c00 x1875495932318976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612728.324535:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932318976:0@lo:400:kworker.0 00010000:00080000:2.0:1788612728.324944:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fed59f80 x1875495932318464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612728.324955:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932318464:0@lo:400:kworker.0 00010000:00010000:1.0:1788612728.751955:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612728.817836:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932319104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612728.817951:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612728.818116:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319104 00000100:00100000:0.0:1788612728.818127:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319104 00000100:00100000:0.0:1788612728.818195:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612728.818208:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932319104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612728.818253:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788612728.818324:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932319104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612728.818331:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612728.818885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932319104:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788612729.137245:0:17195:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612729.137252:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c82bd800 from 13 10000000:01000000:2.0:1788612729.137259:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612729.137303:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612729.137313:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612729.137343:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612729.137366:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.137427:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612729.141582:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612729.143881:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319232 00000100:00100000:1.0:1788612729.143894:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319232 00000100:00100000:0.0:1788612729.146281:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612729.146296:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+16:17195:x1875495932319232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612729.146313:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612729.146342:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc92eb expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612729.146368:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612729.146379:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612729.146386:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897200, rc 0) 00000100:00100000:0.0:1788612729.146473:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932319232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (9044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612729.146505:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788612729.146626:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612729.146644:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612729.146653:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612729.146730:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612729.146764:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612729.153491:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c298d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612729.154066:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319360 00000100:00100000:2.0:1788612729.154076:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319360 00000100:00100000:2.0:1788612729.154127:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612729.154136:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932319360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.154299:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932319360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (7534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612729.154306:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612729.158576:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.158900:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.158975:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612729.159015:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612729.159032:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319488 00000100:00100000:2.0:1788612729.159038:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319488 00000100:00100000:2.0:1788612729.159079:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612729.159088:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932319488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.159194:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932319488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612729.159201:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612729.159255:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788612729.165546:0:18409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788612729.166075:0:17195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788612729.166102:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612729.166112:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612729.166123:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612729.166134:0:17195:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612729.166136:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c816d000 from 13 10000000:01000000:0.0:1788612729.166139:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612729.166174:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612729.166182:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612729.166193:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612729.166218:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612729.166281:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612729.166327:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612729.167288:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319616 00000100:00100000:1.0:1788612729.167296:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319616 00000100:00100000:1.0:1788612729.167378:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612729.167387:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+17:17195:x1875495932319616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612729.167400:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612729.167414:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc92f9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612729.167437:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612729.167447:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612729.167455:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799b400, rc 0) 00000100:00100000:1.0:1788612729.167548:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932319616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612729.167555:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788612729.170336:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612729.170364:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612729.170376:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612729.170466:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.170831:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612729.170867:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612729.170968:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319744 00000100:00100000:0.0:1788612729.170975:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319744 00000100:00100000:0.0:1788612729.171010:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612729.171018:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932319744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612729.171149:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932319744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612729.171157:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612729.172612:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.172665:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612729.172731:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612729.172769:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612729.172876:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932319872 00000100:00100000:1.0:1788612729.172883:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932319872 00000100:00100000:1.0:1788612729.172929:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788612729.172938:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932319872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612729.173038:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:17195:x1875495932319872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612729.173045:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612729.176031:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932319872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788612729.181966:0:18411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788612729.182167:0:17195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788612729.182207:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612729.182218:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612729.182230:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612729.327927:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932320000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612729.328000:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612729.328205:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320000 00000100:00100000:1.0:1788612729.328214:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320000 00000100:00100000:1.0:1788612729.328271:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612729.329357:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932320000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612729.329399:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612729.329815:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932320000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1535us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612729.329824:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612729.329989:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932320000:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788612729.341265:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788612729.779011:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612730.034174:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788612730.800313:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612731.827967:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612732.848655:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612733.427689:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932320128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.427784:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612733.427869:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320128 00000100:00100000:0.0:1788612733.427879:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320128 00000100:00100000:0.0:1788612733.427935:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612733.427945:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3651:x1875495932320128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428005:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:3651:x1875495932320128:12345-0@lo:400:kworker.0 Request processed in 60us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612733.428013:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612733.428069:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932320128:0@lo:400:kworker.0 00000100:00080000:0.0:1788612733.428110:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612733.428115:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612733.428117:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612733.428120:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612733.428132:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932320256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428163:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612733.428199:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320256 00000100:00100000:0.0:1788612733.428203:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320256 00000100:00100000:0.0:1788612733.428228:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788612733.428235:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932320256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428275:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932320256:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612733.428281:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788612733.428310:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932320256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932320384:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428382:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612733.428413:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320384 00000100:00100000:0.0:1788612733.428417:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320384 00000100:00100000:0.0:1788612733.428444:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612733.428451:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932320384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428530:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932320384:12345-0@lo:400:kworker.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612733.428536:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788612733.428565:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c79a8a80 x1875495932320384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612733.428575:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932320384:0@lo:400:kworker.0 00000100:00080000:0.0:1788612733.428605:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612733.428609:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612733.428612:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612733.428615:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612733.428622:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428646:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612733.428675:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320512 00000100:00100000:0.0:1788612733.428678:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320512 00000100:00100000:0.0:1788612733.428697:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788612733.428703:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932320512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428734:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932320512:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612733.428748:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788612733.428771:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428798:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932320640:0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428826:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612733.428853:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320640 00000100:00100000:0.0:1788612733.428857:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320640 00000100:00100000:0.0:1788612733.428878:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612733.428884:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612733.428916:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932320640:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612733.428923:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788612733.428946:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c79a8a80 x1875495932320640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612733.428955:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932320640:0@lo:400:kworker.0 00010000:00010000:0.0:1788612733.875572:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612733.936657:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612733.936685:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932320768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612733.936789:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612733.936863:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320768 00000100:00100000:2.0:1788612733.936873:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320768 00000100:00100000:2.0:1788612733.936962:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612733.936972:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932320768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612733.937018:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788612733.937069:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932320768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612733.937076:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612733.937132:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932320768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612734.447689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932320896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612734.447766:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612734.447910:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932320896 00000100:00100000:1.0:1788612734.447918:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932320896 00000100:00100000:1.0:1788612734.447964:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612734.447973:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932320896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612734.448005:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612734.448047:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932320896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612734.448054:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612734.450585:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932320896:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788612734.900598:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788612735.271557:0:18700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788612735.271560:0:18700:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788612735.271562:0:18700:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788612735.271671:0:18700:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9612fe89a000 00000020:01000004:3.0:1788612735.271694:0:18700:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788612735.271707:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788612735.271721:0:18700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9611c64b8000) 00000020:00000080:3.0:1788612735.271737:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000040:00080000:2.0:1788612735.280562:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:3.0:1788612735.333675:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788612735.335686:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788612735.335945:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788612735.336832:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788612735.337100:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788612735.337446:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788612735.337731:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788612735.340104:0:18700:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788612735.345838:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788612735.345855:0:18700:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788612735.345869:0:18700:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1f8616bf0bc930e 00000020:01000004:3.0:1788612735.345878:0:18700:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788612735.345901:0:18700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788612735.345904:0:18700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788612735.345910:0:18700:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788612735.345915:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788612735.345929:0:18700:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9611c64bb380) 00000020:00000080:3.0:1788612735.345943:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788612735.347144:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612735.347315:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788612735.347322:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788612735.353022:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612735.353036:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788612735.354948:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788612735.354959:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788612735.359369:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612735.360230:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788612735.360238:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788612735.378573:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788612735.378587:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788612735.411659:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612735.411923:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788612735.411931:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788612735.413642:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788612735.413662:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788612735.414652:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788612735.414662:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788612735.416907:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612735.417099:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788612735.417105:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788612735.418001:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788612735.418011:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788612735.473404:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612735.473647:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788612735.473653:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788612735.475366:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788612735.475379:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788612735.476886:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788612735.476919:0:18700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788612735.476926:0:18700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788612735.495310:0:18700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788612735.495347:0:18700:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788612735.495351:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788612735.495353:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612735.495354:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612735.495356:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612735.495357:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612735.495363:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612735.495364:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612735.495365:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612735.495366:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612735.495369:0:18700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788612735.495372:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612735.495373:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612735.495374:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612735.495375:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612735.495376:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612735.495377:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612735.495378:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612735.495378:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612735.495379:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612735.495413:0:18700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788612735.495431:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788612735.496000:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.496056:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612735.496252:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321024 00000100:00100000:3.0:1788612735.496261:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321024 00000100:00100000:3.0:1788612735.496327:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612735.496337:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:18700:x1875495932321024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612735.496386:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788612735.496390:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788612735.496394:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788612735.497165:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:18700:x1875495932321024:12345-0@lo:253:mount.lustre.0 Request processed in 826us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612735.497176:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788612735.497656:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612735.497671:0:18700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788612735.497674:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612735.497675:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612735.497677:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612735.497678:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612735.497679:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612735.497680:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612735.497682:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612735.497684:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612735.497685:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612735.497705:0:18700:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9612fe89a000 from lustre-OST0000 10000000:01000000:0.0:1788612735.497735:0:18700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788612735.497738:0:18700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788612735.497746:0:18700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9611c5a23380 local copy 00010000:00010000:0.0:1788612735.497756:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.497881:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612735.497922:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.497968:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612735.499233:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321152 00000100:00100000:2.0:1788612735.499244:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321152 00000100:00100000:2.0:1788612735.499314:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612735.499325:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:18700:x1875495932321152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612735.499469:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:18700:x1875495932321152:12345-0@lo:501:mount.lustre.0 Request processed in 132us (1532us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612735.499518:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788612735.509164:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321152:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788612735.509197:0:18700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788612735.509267:0:18700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788612735.509278:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612735.509303:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612735.509338:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612fe89a000 10000000:01000000:1.0:1788612735.509343:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612735.509348:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788612735.509351:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612735.509356:0:18700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788612735.509359:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612735.509390:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612735.509398:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612735.509409:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612735.509429:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612735.509522:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612735.509561:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612735.509730:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321280 00000100:00100000:3.0:1788612735.509738:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321280 00000100:00100000:3.0:1788612735.509795:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788612735.509805:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+18:18700:x1875495932321280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612735.509818:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612735.509832:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7241200/0x1f8616bf0bc9323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc931c expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.509854:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7241200/0x1f8616bf0bc9323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc931c expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.509864:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7241200/0x1f8616bf0bc9323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc931c expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.509881:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241200, rc 0) 00000100:00100000:3.0:1788612735.509942:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321280:12345-0@lo:101:mount.lustre.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612735.509949:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612735.509988:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612735.510013:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612735.510021:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612735.515905:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788612735.517021:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612735.521677:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788612735.521736:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788612735.521753:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788612735.521770:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788612735.521790:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788612735.521824:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788612735.521861:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788612735.521867:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788612735.521973:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612735.522042:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612735.522087:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80da000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612735.522095:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321408 00000100:00100000:1.0:1788612735.522105:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321408 00000100:00100000:1.0:1788612735.522159:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788612735.522242:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612735.526688:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321408:12345-0@lo:501:mount.lustre.0 Request processed in 4513us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.526700:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612735.526932:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612735.526983:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612735.527318:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612735.527684:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80da000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612735.533936:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321536 00000100:00100000:0.0:1788612735.533952:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321536 00000100:00100000:0.0:1788612735.534025:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788612735.534036:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612735.535000:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321536:12345-0@lo:503:mount.lustre.0 Request processed in 962us (7679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.535010:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788612735.535125:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612735.535699:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612735.535794:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612735.535843:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612735.535880:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612735.536199:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321664 00000100:00100000:0.0:1788612735.536206:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321664 00000100:00100000:0.0:1788612735.536265:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612735.536275:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612735.536768:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321664:12345-0@lo:502:mount.lustre.0 Request processed in 493us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.536776:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612735.536988:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612735.537195:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788612735.537226:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788612735.537240:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788612735.537276:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788612735.537292:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788612735.537305:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788612735.537316:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788612735.537328:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788612735.537340:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788612735.537352:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788612735.537363:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788612735.537392:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788612735.537422:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612735.537517:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612735.537574:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c82849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612735.538314:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321792 00000100:00100000:0.0:1788612735.538322:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321792 00000100:00100000:0.0:1788612735.538381:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612735.538389:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612735.538544:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321792:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.538559:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788612735.538712:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612735.538784:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788612735.538797:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788612735.543938:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612735.543949:0:18717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788612735.543957:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.543960:0:18717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788612735.543966:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612735.543983:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9611c69d4d40) 00000020:00000080:0.0:1788612735.544006:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788612735.544012:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788612735.544123:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612fe89a000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788612735.544132:0:18717:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788612735.544139:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1f8616bf0bc9331 00010000:00010000:3.0:1788612735.563736:0:18717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788612735.564447:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788612735.572245:0:18717:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788612735.579161:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788612735.579175:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612735.579192:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612735.579195:0:18717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788612735.579199:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612735.579202:0:18717:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788612735.579204:0:18717:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612735.579206:0:18717:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612735.579208:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612735.579211:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612735.579212:0:18717:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612735.579215:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612735.579218:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612735.579220:0:18717:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788612735.579223:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788612735.579231:0:18717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788612735.579234:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612735.579236:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612735.579238:0:18717:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788612735.579240:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612735.579242:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612735.579244:0:18717:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788612735.579935:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788612735.579969:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612735.579973:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612735.579974:0:18717:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788612735.579978:0:18717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788612735.581008:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788612735.581048:0:18700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788612735.581082:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.581094:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612735.581102:0:18700:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fe89a000 from 1 10000000:01000000:2.0:1788612735.581105:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612735.581140:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.581148:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.581158:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612735.581189:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612735.581373:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612735.581417:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612735.581654:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932321920 00000100:00100000:2.0:1788612735.581662:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932321920 00000100:00100000:2.0:1788612735.581706:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788612735.581716:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:18700:x1875495932321920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612735.581729:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612735.581742:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9338 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.581767:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.581779:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.581787:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36e00, rc 0) 00000100:00100000:2.0:1788612735.581831:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932321920:12345-0@lo:101:mount.lustre.0 Request processed in 116us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612735.581839:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788612735.582425:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932321920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612735.582442:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612735.582461:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612735.584618:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788612735.584963:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612735.585681:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788612735.585712:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788612735.585729:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788612735.585733:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788612735.585815:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612735.585904:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612735.585944:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80dad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612735.585960:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322048 00000100:00100000:3.0:1788612735.585967:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322048 00000100:00100000:3.0:1788612735.586016:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788612735.586026:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612735.586140:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322048:12345-0@lo:501:mount.lustre.0 Request processed in 115us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612735.586148:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612735.586265:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612735.586299:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612735.586342:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612735.586374:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612735.586569:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322176 00000100:00100000:3.0:1788612735.586574:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322176 00000100:00100000:3.0:1788612735.586599:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788612735.586607:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612735.586703:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322176:12345-0@lo:503:mount.lustre.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612735.586710:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612735.586785:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322176:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788612735.587171:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612735.587261:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612735.587305:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612735.587339:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612735.587503:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322304 00000100:00100000:3.0:1788612735.587508:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322304 00000100:00100000:3.0:1788612735.587539:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788612735.587546:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612735.587625:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322304:12345-0@lo:502:mount.lustre.0 Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612735.587633:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612735.588382:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612735.588616:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788612735.588645:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788612735.588659:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788612735.588672:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788612735.588683:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788612735.588695:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788612735.588710:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788612735.588742:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788612735.588757:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788612735.588768:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788612735.588778:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788612735.588804:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612735.589146:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612735.589186:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612735.589462:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322432 00000100:00100000:2.0:1788612735.589469:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322432 00000100:00100000:2.0:1788612735.589528:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788612735.589537:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612735.589649:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322432:12345-0@lo:502:mount.lustre.0 Request processed in 112us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612735.589657:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612735.590052:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612735.590135:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788612735.590148:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788612735.601940:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612735.601953:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.601956:0:18721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788612735.601964:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612fe89a000 00000020:00000080:0.0:1788612735.601967:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612735.601975:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612735.601978:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.601980:0:18721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788612735.601982:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612735.601985:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.601986:0:18721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788612735.601990:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612fe89a000 00000020:00000080:0.0:1788612735.601992:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612735.602054:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612735.607223:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.607232:0:18721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788612735.607245:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612735.607252:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.607254:0:18721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788612735.607260:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612fe89a000 00000020:00000080:0.0:1788612735.607268:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612735.607322:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612735.607325:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.607327:0:18721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788612735.607329:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612735.607332:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.607333:0:18721:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788612735.607337:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612fe89a000 00000020:00000080:0.0:1788612735.607339:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612735.607381:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612735.607383:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612735.607385:0:18721:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788612735.607388:0:18721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788612735.616672:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788612735.616720:0:18700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612735.616738:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.616750:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612735.616823:0:18700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788612735.616826:0:18700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612fe89a000 10000000:01000000:3.0:1788612735.616836:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612fe89a000 10000000:01000000:3.0:1788612735.616841:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612735.616847:0:18700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612fe89a000 from 1 10000000:01000000:3.0:1788612735.616850:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612735.616884:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.616906:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.616917:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612735.616942:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612735.617013:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612735.617052:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1282300 going to sleep for 11 seconds 00000100:00100000:2.0:1788612735.624429:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322560 00000100:00100000:2.0:1788612735.624444:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322560 00000100:00100000:2.0:1788612735.624532:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788612735.624543:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:18700:x1875495932322560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612735.624559:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612735.624578:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc934d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9346 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.624607:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc934d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9346 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.624617:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc934d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9346 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612735.624625:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37200, rc 0) 00000100:00100000:2.0:1788612735.624700:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322560:12345-0@lo:101:mount.lustre.0 Request processed in 160us (7688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612735.624707:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788612735.626111:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612735.626138:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612735.626150:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612735.629805:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788612735.630099:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612735.630696:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788612735.630729:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788612735.630746:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788612735.630761:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788612735.631027:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788612735.631045:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788612735.631059:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788612735.631071:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788612735.631084:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788612735.631097:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788612735.631109:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788612735.631122:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788612735.631136:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788612735.631150:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788612735.631525:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788612735.631540:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788612735.631551:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788612735.631564:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788612735.631575:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788612735.631585:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788612735.631854:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788612735.631872:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788612735.631887:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788612735.631911:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788612735.631925:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788612735.631938:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788612735.631952:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788612735.631964:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788612735.631976:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788612735.631989:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788612735.632019:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788612735.632034:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788612735.632047:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788612735.632058:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788612735.632071:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788612735.632083:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788612735.632094:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788612735.632115:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788612735.632122:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788612735.633731:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612735.633888:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612735.633947:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d12826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612735.635158:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322688 00000100:00100000:0.0:1788612735.635172:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322688 00000100:00100000:0.0:1788612735.635232:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788612735.635733:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612735.635901:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322688:12345-0@lo:501:mount.lustre.0 Request processed in 658us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.635908:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788612735.638510:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612735.638578:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612735.639446:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612735.639522:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d12826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612735.641801:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322816 00000100:00100000:1.0:1788612735.641814:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322816 00000100:00100000:1.0:1788612735.641872:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612735.641885:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612735.642123:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322816:12345-0@lo:503:mount.lustre.0 Request processed in 242us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.642132:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788612735.642897:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612735.643944:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612735.644038:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612735.644113:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612735.644722:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1282300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612735.646896:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932322944 00000100:00100000:0.0:1788612735.646909:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932322944 00000100:00100000:0.0:1788612735.647012:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612735.647023:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612735.647207:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932322944:12345-0@lo:502:mount.lustre.0 Request processed in 184us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.647215:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612735.647304:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932322944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612735.647556:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788612735.647587:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788612735.647599:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788612735.647610:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788612735.647620:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788612735.647632:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788612735.647643:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788612735.647653:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788612735.647665:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788612735.647676:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788612735.647701:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788612735.647714:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788612735.647725:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788612735.647736:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788612735.647748:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788612735.647758:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788612735.647769:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788612735.647780:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788612735.647790:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788612735.647801:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788612735.647812:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788612735.647824:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788612735.647835:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788612735.647849:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788612735.647862:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788612735.647875:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788612735.647901:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788612735.647916:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788612735.647928:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788612735.647941:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788612735.647954:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788612735.647967:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788612735.647989:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788612735.648001:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788612735.648013:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788612735.648025:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788612735.648037:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788612735.648049:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788612735.648061:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788612735.648073:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788612735.648086:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788612735.648098:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788612735.648126:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788612735.648141:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788612735.648157:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788612735.648171:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788612735.648184:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788612735.648197:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788612735.648242:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932323072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612735.648300:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612735.648697:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612735.648755:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323072 00000100:00100000:1.0:1788612735.648765:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323072 00000100:00100000:1.0:1788612735.648803:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788612735.648812:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932323072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612735.648973:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932323072:12345-0@lo:502:mount.lustre.0 Request processed in 161us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.648982:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788612735.649098:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932323072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612735.649288:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788612735.649313:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788612735.649336:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932323200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612735.649373:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612735.649428:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9613007e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612735.649471:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323200 00000100:00100000:1.0:1788612735.649581:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323200 00000100:00100000:1.0:1788612735.649651:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788612735.649661:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932323200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612735.649744:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932323200:12345-0@lo:502:mount.lustre.0 Request processed in 85us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.649752:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612735.649818:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932323200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612735.649864:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788612735.649879:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788612735.650570:0:18727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788612735.650590:0:18727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9612fb85cd40) 00000020:00000080:0.0:1788612735.650625:0:18727:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788612735.650714:0:18727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612fe89a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788612735.650718:0:18727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fe89a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788612735.650722:0:18727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fe89a000 3 00010000:00080000:0.0:1788612735.650751:0:18727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c882e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612735.652446:0:18727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788612735.653005:0:18727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788612735.653056:0:18727:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612735.653069:0:18727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1f8616bf0bc935b 00000100:00080000:0.0:1788612735.653080:0:18727:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612735.653087:0:18727:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c882e800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612735.653121:0:18727:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c79ab100 x1875495932323328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612735.653162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932323328:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612735.653227:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.653289:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323328 00000100:00100000:0.0:1788612735.653295:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323328 00000100:00100000:0.0:1788612735.653325:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612735.653333:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932323328:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788612735.653355:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1788612735.653407:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1f8616bf0bc9362 00000004:00100000:0.0:1788612735.653422:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788612735.653710:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9611c882f800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788612735.657718:0:18727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788612735.659289:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875495932323328:12345-0@lo:38:llog_process_th.0 Request processed in 5947us (6053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.659312:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612735.659438:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932323456:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.659541:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612735.659661:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.659666:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612735.659669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.659672:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612735.659918:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612735.659932:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932323584:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.659961:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612735.660053:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323456 00000100:00100000:2.0:1788612735.660059:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323456 00000100:00100000:2.0:1788612735.660096:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612735.660104:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932323456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.660150:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932323456:12345-0@lo:400:kworker.0 Request processed in 46us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612735.660156:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612735.660187:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932323456:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.660504:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932323712:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.660531:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612735.660581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.660585:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612735.660587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.660590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612735.660640:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323584 00000100:00100000:1.0:1788612735.660644:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323584 00000100:00100000:1.0:1788612735.660669:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612735.660676:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932323584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612735.660717:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932323584:12345-0@lo:400:kworker.0 Request processed in 42us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.660724:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612735.660741:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323712 00000100:00100000:1.0:1788612735.660744:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323712 00000100:00100000:1.0:1788612735.660759:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612735.660764:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932323712:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788612735.660850:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c79ab100 x1875495932323328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612735.660860:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612735.660868:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788612735.660876:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612735.660880:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612735.660884:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612735.660890:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932323328:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788612735.660955:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932323712:12345-0@lo:400:kworker.0 Request processed in 190us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.660962:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788612735.660988:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c79a8a80 x1875495932323584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612735.660998:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932323584:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.661034:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932323712:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.661042:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612735.661047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932323840:0@lo:400:kworker.0 00000100:00100000:2.0:1788612735.661072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788612735.661224:0:18727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788612735.661239:0:18727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9612fcfc4d40) 00000020:00000080:2.0:1788612735.661258:0:18727:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788612735.661327:0:18727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612fe89a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612735.661330:0:18727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fe89a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612735.661333:0:18727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fe89a000 3 00010000:00080000:2.0:1788612735.661356:0:18727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c7524800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612735.662979:0:18727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788612735.663158:0:18727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788612735.663198:0:18727:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612735.663210:0:18727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1f8616bf0bc9370 00000100:00080000:2.0:1788612735.663227:0:18727:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612735.663234:0:18727:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9611c7524800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612735.663278:0:18727:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c7b4ed80 x1875495932323968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612735.663308:0:18727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788612735.663528:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323840 00000100:00100000:1.0:1788612735.663536:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323840 00000100:00100000:1.0:1788612735.663579:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612735.663588:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932323840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612735.663669:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932323840:12345-0@lo:400:kworker.0 Request processed in 82us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.663677:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612735.664745:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932323968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612735.664804:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612735.664875:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.664879:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612735.664887:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.664891:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612735.664894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.664897:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612735.664909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612735.664913:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612735.665019:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932323968 00000100:00100000:1.0:1788612735.665026:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932323968 00000100:00100000:1.0:1788612735.665060:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612735.665067:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875495932323968:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788612735.665091:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1788612735.665124:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1f8616bf0bc9377 00000004:00100000:1.0:1788612735.665143:0:17199:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788612735.665172:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9611c1094000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612735.665211:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875495932323968:12345-0@lo:38:llog_process_th.0 Request processed in 143us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612735.665218:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788612735.665514:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c7b4ed80 x1875495932323968/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612735.665525:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612735.665534:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788612735.665541:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612735.665546:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788612735.665548:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c7524800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612735.665554:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932323968:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788612735.665892:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c79ab480 x1875495932323840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612735.665904:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932323840:0@lo:400:kworker.0 00000040:00080000:2.0:1788612735.667243:0:18727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788612735.667364:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788612735.667394:0:18700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612735.667417:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.667428:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788612735.667519:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788612735.667522:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612735.667523:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612735.667528:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612735.667529:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612735.667531:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612735.667532:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612735.667534:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612735.667535:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612735.667539:0:18700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788612735.667541:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612735.667542:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612735.667543:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612735.667544:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612735.667545:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612735.667546:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612735.667547:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612735.667548:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612735.667549:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612735.667572:0:18700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788612735.667591:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932324096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788612735.667667:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.667708:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612735.667858:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324096 00000100:00100000:3.0:1788612735.667867:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324096 00000100:00100000:3.0:1788612735.667912:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788612735.667921:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932324096:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612735.667949:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788612735.667963:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788612735.696905:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788612735.696958:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788612735.699383:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:18700:x1875495932324096:12345-0@lo:253:mount.lustre.0 Request processed in 31454us (31719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612735.699398:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788612735.699575:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:18700:1875495932324096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788612735.699602:0:18700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788612735.699606:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612735.699608:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612735.699609:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612735.699610:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612735.699612:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612735.699613:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612735.699614:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612735.699616:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612735.699618:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612735.699634:0:18700:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788612735.705045:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788612735.705056:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788612735.705139:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705160:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705167:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705175:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705216:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705234:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 20 pid: 17192 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.705270:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932324224:0@lo:104: 00000100:00100000:0.0:1788612735.705334:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612735.705394:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705402:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 20 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.705410:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932324352:0@lo:104: 00000100:00100000:0.0:1788612735.705436:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.705497:0:17182:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788612735.705515:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324224 00000100:00100000:0.0:1788612735.705520:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324224 00000100:00100000:0.0:1788612735.705553:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324352 00000100:00100000:0.0:1788612735.705557:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324352 00000100:00100000:0.0:1788612735.705570:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612735.705578:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:17214:x1875495932324224:12345-0@lo:104: 00010000:00010000:0.0:1788612735.705591:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705632:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612735.705637:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:17214:x1875495932324224:12345-0@lo:104: Request processed in 60us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.705644:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612735.705662:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612735.705669:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932324352:12345-0@lo:104: 00010000:00010000:0.0:1788612735.705675:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705714:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612735.705719:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932324352:12345-0@lo:104: Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.705725:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788612735.705761:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612735.705766:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705773:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612735.705777:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705785:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612735.705792:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612735.705947:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612735.705978:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.705985:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612735.706002:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706009:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc92cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92d6 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706031:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612735.706035:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706041:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612735.706043:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706050:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612735.706057:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612735.706062:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612735.706076:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706081:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612735.706088:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706094:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b36a00/0x1f8616bf0bc92c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92c8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706106:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612735.706108:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612735.706109:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612735.706116:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612735.706133:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932324608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612735.706163:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.706187:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612735.706193:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932324480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612735.706219:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612735.706262:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324608 00000100:00100000:0.0:1788612735.706266:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324608 00010000:00010000:0.0:1788612735.706283:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 21 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.706303:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324480 00000100:00100000:0.0:1788612735.706306:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324480 00010000:00010000:0.0:1788612735.706315:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 22 pid: 17192 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.706325:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612735.706332:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:3651:x1875495932324608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612735.706341:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612735.706346:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 22 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706354:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 22 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706369:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612735.706399:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:3651:x1875495932324608:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.706405:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612735.706418:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612735.706423:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ff0c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3651:x1875495932324480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612735.706438:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612735.706442:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 21 pid: 17192 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706468:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 21 pid: 17192 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706499:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706507:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788612735.706520:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005067850s 00010000:00010000:0.0:1788612735.706526:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706533:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706540:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706547:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706552:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612735.706556:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706563:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706578:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706587:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612735.706609:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ff0c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3651:x1875495932324480:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612735.706615:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612735.706692:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932324480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612735.706701:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932324608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612735.706730:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d240 going to sleep for 11 seconds 00010000:00010000:0.0:1788612735.706742:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc92d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc92cf expref: 20 pid: 17192 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.706751:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932324224:0@lo:104: 00010000:00010000:0.0:1788612735.706759:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc92c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc92c1 expref: 19 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612735.706767:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932324352:0@lo:104: 00010000:00010000:0.0:1788612735.706779:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706788:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706794:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612735.706811:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc937e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788612735.710620:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788612735.728887:0:18700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788612735.728898:0:18700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788612735.728933:0:18700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612735.728983:0:18700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612735.729003:0:18700:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788612735.729034:0:18700:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788612735.736010:0:18700:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612735.737826:0:18700:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612735.921894:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612736.610156:0:18779:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612736.611846:0:18779:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788612736.817917:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612736.817925:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c82bd800 from 9 10000000:01000000:1.0:1788612736.817930:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612736.817977:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.817989:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.818001:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612736.818028:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932324736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612736.818101:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612736.818149:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612736.818188:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324736 00000100:00100000:0.0:1788612736.818197:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324736 00000100:00100000:0.0:1788612736.818262:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788612736.818275:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:17195:x1875495932324736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612736.818289:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612736.818304:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9385 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612736.818330:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612736.818341:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612736.818350:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897a00, rc 0) 00000100:00100000:0.0:1788612736.818391:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:17195:x1875495932324736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612736.818398:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612736.818951:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932324736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612736.818972:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.818983:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612736.819040:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932324864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788612736.819092:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612736.819118:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612736.819133:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324864 00000100:00100000:1.0:1788612736.819137:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324864 00000100:00100000:1.0:1788612736.819170:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788612736.819178:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:17195:x1875495932324864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788612736.819193:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612736.819210:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612736.819214:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788612736.819297:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:17195:x1875495932324864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612736.819304:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788612736.819340:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932324864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788612736.819394:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612736.819402:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612736.819410:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612736.819419:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612736.819420:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c816d000 from 9 10000000:01000000:0.0:1788612736.819423:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612736.819453:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612736.819460:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612736.819468:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612736.819497:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932324992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612736.819527:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612736.819550:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7956f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612736.821281:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932324992 00000100:00100000:1.0:1788612736.821293:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932324992 00000100:00100000:1.0:1788612736.821350:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788612736.821360:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:17195:x1875495932324992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612736.821375:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612736.821392:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9393 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.821416:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.821427:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.821435:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ac00, rc 0) 00000100:00100000:1.0:1788612736.821533:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932324992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612736.821550:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788612736.821602:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932324992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612736.821623:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.821633:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612736.821697:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932325120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788612736.821735:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612736.821778:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612736.821792:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325120 00000100:00100000:1.0:1788612736.821796:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325120 00000100:00100000:1.0:1788612736.821819:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788612736.821825:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932325120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788612736.821839:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612736.821855:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612736.821859:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788612736.824200:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932325120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2365us (2456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612736.824214:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612736.829309:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932325120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788612736.829402:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612736.829414:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612736.829439:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612736.947197:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612737.974389:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612738.994321:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612739.056776:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612739.056827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932325248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612739.057277:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612739.057457:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325248 00000100:00100000:1.0:1788612739.057499:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325248 00000100:00100000:1.0:1788612739.057545:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612739.057554:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932325248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612739.057591:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788612739.057641:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932325248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612739.057648:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612739.058321:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932325248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612739.574851:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932325376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612739.574924:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612739.575034:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325376 00000100:00100000:0.0:1788612739.575043:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325376 00000100:00100000:0.0:1788612739.575087:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612739.575101:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932325376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612739.575137:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612739.575181:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932325376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612739.575188:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612739.575547:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932325376:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788612740.018606:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612740.273715:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788612741.039637:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612741.105424:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612741.105431:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612741.105434:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612741.105437:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612741.105466:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612741.105469:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612741.105472:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612741.105489:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612741.105560:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932325504:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.105631:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.105667:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932326016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.105692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.105717:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788612741.105723:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932325632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612741.105977:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325504 00000100:00100000:2.0:1788612741.105986:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325504 00000100:00100000:2.0:1788612741.106032:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788612741.106041:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c32b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3650:x1875495932325504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612741.106084:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c32b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3650:x1875495932325504:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612741.106091:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788612741.106926:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.106957:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932326144:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.106996:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.107032:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932325504:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.107069:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932325760:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.107095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.109234:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932326272:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.109303:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612741.109309:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932325888:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612741.109502:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326016 00000100:00100000:0.0:1788612741.109510:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326016 00000100:00100000:0.0:1788612741.109544:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326144 00000100:00100000:0.0:1788612741.109547:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326144 00000100:00100000:0.0:1788612741.109575:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325760 00000100:00100000:0.0:1788612741.109578:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325760 00000100:00100000:0.0:1788612741.109588:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326272 00000100:00100000:0.0:1788612741.109590:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326272 00000100:00100000:0.0:1788612741.109606:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612741.109613:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932326016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109663:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932326016:12345-0@lo:400:kworker.0 Request processed in 50us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612741.109671:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612741.109687:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612741.109693:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932326144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109719:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932326144:12345-0@lo:400:kworker.0 Request processed in 26us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612741.109734:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612741.109747:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612741.109752:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932325760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109782:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932325760:12345-0@lo:400:kworker.0 Request processed in 30us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612741.109788:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612741.109798:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612741.109803:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932326272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109829:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932326272:12345-0@lo:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612741.109835:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612741.109867:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325632 00000100:00100000:0.0:1788612741.109871:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325632 00000100:00100000:0.0:1788612741.109892:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932325888 00000100:00100000:0.0:1788612741.109895:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932325888 00000100:00100000:0.0:1788612741.109907:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612741.109912:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932325632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109946:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932325632:12345-0@lo:400:kworker.0 Request processed in 32us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612741.109951:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612741.109963:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612741.109968:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932325888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.109994:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932325888:12345-0@lo:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612741.109999:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612741.110133:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932325632:0@lo:400:kworker.0 00010000:00080000:0.0:1788612741.110148:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c79a8a80 x1875495932326144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612741.110159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932326144:0@lo:400:kworker.0 00010000:00080000:0.0:1788612741.110170:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c79a8e00 x1875495932326016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612741.110179:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932326016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612741.110211:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932325888:0@lo:400:kworker.0 00010000:00080000:0.0:1788612741.110220:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c79aaa00 x1875495932325760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612741.110228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932325760:0@lo:400:kworker.0 00010000:00080000:0.0:1788612741.110237:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c79a8000 x1875495932326272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612741.110244:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932326272:0@lo:400:kworker.0 00000100:00080000:0.0:1788612741.110381:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612741.110386:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612742.063965:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788612742.314933:0:19069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788612743.095565:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788612743.216341:0:19121:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612743.216629:0:19121:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788612743.855552:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612728/real 1788612728] req@ffff9612fed5bb80 x1875495932318720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612743 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612743.855584:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fed5bb80 x1875495932318720/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612743 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612743.855596:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612728/real 1788612728] req@ffff9612fed59500 x1875495932318848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612743 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612743.855607:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fed59500 x1875495932318848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612743 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612743.855626:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612743.855720:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612743.855725:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932318720:0@lo:8:kworker.0 00000100:00080000:1.0:1788612743.855749:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612743.855755:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612743.855758:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932318848:0@lo:8:kworker.0 00000100:00080000:0.0:1788612743.855920:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612743.855925:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612743.855927:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612743.855930:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612743.855947:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612743.855950:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788612743.855960:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612743.855965:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1788612743.855970:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788612743.855976:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9611c78b1000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612743.855995:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed73800 x1875495932326912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612743.856007:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612743.856010:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788612743.856012:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612743.856015:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1788612743.856017:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788612743.856021:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612fccfd800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612743.856033:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed71880 x1875495932327040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612743.856075:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932326656:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.856132:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612743.856161:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932327424:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.856183:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612743.856201:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788612743.856307:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932326784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612743.856360:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788612743.856366:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932326400:0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856406:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612743.856428:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932327168:0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612743.856504:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326784 00000100:00100000:2.0:1788612743.856511:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326784 00000100:00100000:2.0:1788612743.856553:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612743.856562:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932326784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856613:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932326784:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612743.856620:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612743.856720:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326656 00000100:00100000:2.0:1788612743.856731:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326656 00000100:00100000:2.0:1788612743.856753:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327424 00000100:00100000:2.0:1788612743.856755:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327424 00000100:00100000:2.0:1788612743.856778:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327168 00000100:00100000:2.0:1788612743.856780:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327168 00000100:00100000:2.0:1788612743.856792:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612743.856798:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932326656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856830:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932326656:12345-0@lo:400:kworker.0 Request processed in 32us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612743.856837:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612743.856849:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612743.856855:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932327424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856883:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932327424:12345-0@lo:400:kworker.0 Request processed in 28us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612743.856889:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612743.856899:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612743.856905:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932327168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856930:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932327168:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612743.856935:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788612743.856954:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788612743.856977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73b80 x1875495932327168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612743.856988:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932327168:0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.856997:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932326784:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.857311:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932326528:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.857342:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612743.857369:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932327296:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.857390:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788612743.857423:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73100 x1875495932326656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612743.857446:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932326656:0@lo:400:kworker.0 00010000:00080000:0.0:1788612743.857460:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed72300 x1875495932327424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612743.857468:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932327424:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.857512:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327296 00000100:00100000:0.0:1788612743.857516:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327296 00000100:00100000:0.0:1788612743.857549:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612743.857556:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932327296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.857594:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932327296:12345-0@lo:400:kworker.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612743.857600:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788612743.857631:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71500 x1875495932327296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612743.858319:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326400 00000100:00100000:1.0:1788612743.858325:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326400 00000100:00100000:1.0:1788612743.858370:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788612743.858378:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c65fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3648:x1875495932326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612743.858436:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c65fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3648:x1875495932326400:12345-0@lo:400:kworker.0 Request processed in 59us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612743.858443:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788612743.858708:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932326912:0@lo:8:kworker.0 00000100:00100000:1.0:1788612743.858748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612743.858779:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932327040:0@lo:8:kworker.0 00000100:00100000:1.0:1788612743.858802:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612743.858837:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326912 00000100:00100000:1.0:1788612743.858841:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326912 00000100:00100000:1.0:1788612743.858857:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327040 00000100:00100000:1.0:1788612743.858859:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327040 00000100:00100000:1.0:1788612743.858869:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612743.858873:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875495932326912:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788612743.858904:0:18706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1788612743.858931:0:18706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc93a1 00002000:00100000:1.0:1788612743.858945:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9611c1095800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788612743.858949:0:18706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788612743.858951:0:18706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788612743.859128:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788612743.859152:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9611c1092800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612743.859195:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932326912:12345-0@lo:8:kworker.0 Request processed in 319us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612743.859202:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612743.859328:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932326528 00000100:00100000:2.0:1788612743.859339:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932326528 00000100:00100000:2.0:1788612743.859371:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612743.859379:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932326528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612743.859425:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932326528:12345-0@lo:400:kworker.0 Request processed in 47us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612743.859431:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788612743.859450:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612743.859557:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612743.859562:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932327040:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788612743.859577:0:18704:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788612743.862712:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932327296:0@lo:400:kworker.0 00000100:00100000:0.0:1788612743.862762:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932326528:0@lo:400:kworker.0 00010000:00080000:1.0:1788612743.863349:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73800 x1875495932326912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612743.863359:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612743.863368:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788612743.863377:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788612743.863382:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788612743.863385:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788612743.863417:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788612743.863423:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932326912:0@lo:8:kworker.0 00000100:00100000:1.0:1788612743.863460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932326400:0@lo:400:kworker.0 00000004:00080000:0.0:1788612743.864735:0:17941:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788612743.864763:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1875495932327680:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788612743.864829:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612743.864868:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c88bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612743.865600:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612743.865618:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932327552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612743.865730:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612743.865788:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788612743.865797:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1788612743.866605:0:17940:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788612743.866712:0:17940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 558250235021ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788612743.866718:0:17940:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788612743.868080:0:17931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788612743.868249:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327552 00000100:00100000:0.0:1788612743.868260:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327552 00000100:00100000:0.0:1788612743.868323:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612743.868333:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875495932327552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612743.868371:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788612743.868456:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875495932327552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612743.868463:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788612743.868604:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed70e00 x1875495932327552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612743.868623:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932327552:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788612743.868766:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612743.868872:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327680 00000100:00100000:1.0:1788612743.868877:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327680 00000100:00100000:0.0:1788612743.869110:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612743.869117:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17941:x1875495932327680:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788612743.877299:0:19152:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788612743.877309:0:19152:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788612743.877415:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17941:x1875495932327680:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8294us (12581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612743.877426:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788612743.877536:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed71500 x1875495932327680/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612743.877552:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1875495932327680:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788612743.877580:0:17941:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788612743.877622:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1875495932327808:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788612743.877733:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612743.877763:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c88bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612743.878066:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327808 00000100:00100000:0.0:1788612743.878073:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327808 00000100:00100000:0.0:1788612743.878115:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612743.878123:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17941:x1875495932327808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788612743.878148:0:18706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788612743.878253:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17941:x1875495932327808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 129us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612743.878260:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788612743.886515:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc4380 x1875495932327808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612743.886535:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1875495932327808:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788612743.886552:0:17941:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788612743.886606:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1875495932327936:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788612743.887309:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612743.887349:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612743.887431:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932327936 00000100:00100000:0.0:1788612743.887438:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932327936 00000100:00100000:0.0:1788612743.887522:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612743.887531:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17941:x1875495932327936:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788612743.887585:0:19152:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788612743.897254:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932327040:12345-0@lo:8:kworker.0 Request processed in 37682us (38442us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612743.897268:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788612743.897521:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612743.897527:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612743.897532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932327040:0@lo:8:kworker.0 00000001:00080000:0.0:1788612743.933065:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788612743.933079:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788612743.933416:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17941:x1875495932327936:12345-0@lo:5:osp-pre-0-1.0 Request processed in 45882us (46105us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788612743.933431:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788612743.933644:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c7b4f800 x1875495932327936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612759 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612743.933656:0:17941:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788612743.933662:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1875495932327936:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788612743.933675:0:17941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788612743.934618:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17941:1875495932328064:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788612743.934683:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612743.934715:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612743.934797:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328064 00000100:00100000:0.0:1788612743.934804:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328064 00000100:00100000:0.0:1788612743.934848:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612743.934857:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17941:x1875495932328064:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788612743.934910:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17941:x1875495932328064:12345-0@lo:900:osp-pre-0-1.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612743.934916:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612743.934946:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c815dc00 x1875495932328064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612759 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612743.934956:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17941:1875495932328064:0@lo:900:osp-pre-0-1.0 00000020:00000004:0.0:1788612744.064301:0:19172:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612744.064825:0:19172:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612744.120460:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612744.179777:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612744.179801:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932328192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612744.179935:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612744.179992:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328192 00000100:00100000:1.0:1788612744.180000:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328192 00000100:00100000:1.0:1788612744.180049:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612744.180058:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932328192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612744.180090:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788612744.180146:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932328192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612744.180153:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612744.180198:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932328192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612744.691677:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612744.691698:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932328320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612744.691760:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612744.691848:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328320 00000100:00100000:1.0:1788612744.691856:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328320 00000100:00100000:1.0:1788612744.692004:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612744.692014:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932328320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612744.692048:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612744.692096:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932328320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612744.692103:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612744.692140:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932328320:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788612745.136948:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612745.526621:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788612746.163285:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612747.185935:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612748.209734:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612748.977272:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612728/real 1788612728] req@ffff9612fed59880 x1875495932318208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.977334:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fed59880 x1875495932318208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.977342:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612728/real 1788612728] req@ffff9612fed58e00 x1875495932318336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.977352:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fed58e00 x1875495932318336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612748.977380:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612748.977406:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788612748.977410:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932318208:0@lo:8:kworker.0 00000100:00080000:2.0:1788612748.977416:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612748.977421:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788612748.977424:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932318336:0@lo:8:kworker.0 00000100:00100000:3.0:1788612748.978015:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612748.978030:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932328448:0@lo:400:kworker.0 00000100:00100000:3.0:1788612748.978093:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612748.978159:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932328576:0@lo:400:kworker.0 00000100:00100000:3.0:1788612748.978187:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612748.978226:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328576 00000100:00100000:3.0:1788612748.978233:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328576 00000100:00100000:3.0:1788612748.978273:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612748.978281:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932328576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612748.978329:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932328576:12345-0@lo:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612748.978335:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612748.978382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932328576:0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.978550:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328448 00000100:00100000:2.0:1788612748.978555:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328448 00000100:00100000:2.0:1788612748.978589:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612748.978596:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c65f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3650:x1875495932328448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.978634:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c65f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3650:x1875495932328448:12345-0@lo:400:kworker.0 Request processed in 38us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612748.978639:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612748.978677:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932328448:0@lo:400:kworker.0 00000100:00080000:1.0:1788612748.978829:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612748.978834:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788612748.978838:0:15779:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612748.978842:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1788612748.978847:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788612748.978851:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff961300767000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612748.978878:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc4700 x1875495932328704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612748.978901:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612748.978905:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612748.978907:0:15779:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612748.978910:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1788612748.978912:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788612748.978915:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961300767800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612748.978926:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc7480 x1875495932328832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612748.979022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932328704:0@lo:8:kworker.0 00000100:00100000:3.0:1788612748.979058:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612748.979187:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612748.979191:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612748.979193:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612748.979197:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1788612748.979199:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788612748.979203:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612fccfd800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612748.979214:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc5c00 x1875495932329344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612748.979270:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328704 00000100:00100000:1.0:1788612748.979274:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328704 00000100:00100000:1.0:1788612748.979295:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612748.979300:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932328704:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788612748.979324:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 563 last 0 00000020:00000080:1.0:1788612748.979351:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc93a8 00002000:00100000:1.0:1788612748.979374:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9611c1097000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788612748.979378:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788612748.979381:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788612748.979540:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932328960:0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.979571:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612748.979602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932329600:0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.979628:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612748.979645:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612748.979650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932329472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.979669:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612748.979694:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328960 00000100:00100000:2.0:1788612748.979697:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328960 00000100:00100000:2.0:1788612748.979719:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329600 00000100:00100000:2.0:1788612748.979722:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329600 00000100:00100000:2.0:1788612748.979744:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329472 00000100:00100000:2.0:1788612748.979747:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329472 00000100:00100000:2.0:1788612748.979758:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612748.979764:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932328960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.979801:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932328960:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612748.979807:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612748.979819:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612748.979825:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932329600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.979849:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932329600:12345-0@lo:400:kworker.0 Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612748.979854:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612748.979864:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612748.979869:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932329472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.979890:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932329472:12345-0@lo:400:kworker.0 Request processed in 21us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612748.979896:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788612748.979926:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc5500 x1875495932329472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.979957:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932329472:0@lo:400:kworker.0 00010000:00080000:2.0:1788612748.979970:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6300 x1875495932328960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.979979:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932328960:0@lo:400:kworker.0 00010000:00080000:2.0:1788612748.979988:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc6680 x1875495932329600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.979996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932329600:0@lo:400:kworker.0 00002000:00080000:1.0:1788612748.980169:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612748.980192:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9611c1091000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612748.980229:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932328704:12345-0@lo:8:kworker.0 Request processed in 927us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612748.980236:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788612748.980256:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612748.980266:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932329216:0@lo:400:kworker.0 00000100:00100000:1.0:1788612748.980291:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612748.980322:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788612748.980328:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932329088:0@lo:400:kworker.0 00000100:00100000:1.0:1788612748.980350:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612748.980380:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932329728:0@lo:400:kworker.0 00000100:00100000:3.0:1788612748.980674:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932328832:0@lo:8:kworker.0 00000100:00100000:3.0:1788612748.980707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612748.980731:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932329344:0@lo:8:kworker.0 00000100:00100000:3.0:1788612748.980755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788612748.980782:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc4700 x1875495932328704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612748.980804:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612748.980812:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788612748.980819:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788612748.980824:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788612748.980826:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788612748.980838:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788612748.980843:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932328704:0@lo:8:kworker.0 00000100:00100000:3.0:1788612748.980867:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329216 00000100:00100000:3.0:1788612748.980871:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329216 00000100:00100000:3.0:1788612748.980902:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932328832 00000100:00100000:3.0:1788612748.980905:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932328832 00000100:00100000:3.0:1788612748.980912:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329344 00000100:00100000:3.0:1788612748.980914:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329344 00000100:00100000:3.0:1788612748.980923:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612748.980930:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932329216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612748.980974:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932329216:12345-0@lo:400:kworker.0 Request processed in 45us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612748.980980:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612748.980994:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612748.980997:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932328832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788612748.981011:0:18707:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788612748.981669:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612748.981705:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc4a80 x1875495932329216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612748.981715:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932329216:0@lo:400:kworker.0 00000100:00100000:1.0:1788612748.981753:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329088 00000100:00100000:1.0:1788612748.981757:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329088 00000100:00100000:1.0:1788612748.981791:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612748.981797:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932329088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612748.981838:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932329088:12345-0@lo:400:kworker.0 Request processed in 40us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612748.981844:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000004:00080000:1.0:1788612748.981864:0:17222:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788612748.982577:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612748.982583:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932329344:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788612748.982600:0:18704:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788612748.982649:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932329344:12345-0@lo:8:kworker.0 Request processed in 65us (1893us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612748.982655:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612748.982681:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329728 00000100:00100000:2.0:1788612748.982685:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329728 00000100:00100000:2.0:1788612748.982717:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612748.982723:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932329728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612748.982753:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932329728:12345-0@lo:400:kworker.0 Request processed in 31us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612748.982758:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788612748.982791:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612748.982796:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612748.982800:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932329344:0@lo:8:kworker.0 00000004:00080000:0.0:1788612748.982953:0:17223:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788612748.982973:0:17223:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875495932329984:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788612748.983006:0:17223:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612748.983023:0:17223:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcd780c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788612748.984831:0:17222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563368351945ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788612748.984845:0:17222:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788612748.984888:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329984 00000100:00100000:1.0:1788612748.984897:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329984 00000100:00100000:1.0:1788612748.985080:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612748.985092:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17223:x1875495932329984:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788612748.985332:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612748.985347:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932329856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612748.987167:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612748.987296:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932329856 00000100:00100000:1.0:1788612748.987305:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932329856 00000100:00100000:1.0:1788612748.987351:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612748.987370:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932329856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612748.988722:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788612748.988809:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932329856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1447us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612748.988817:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612748.988877:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932329088:0@lo:400:kworker.0 00010000:00080000:1.0:1788612748.988894:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc4e00 x1875495932329728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612748.988912:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932329728:0@lo:400:kworker.0 00010000:00080000:2.0:1788612748.990834:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73100 x1875495932329856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612748.990857:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932329856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788612748.996063:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612748.996072:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788612748.996819:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788612748.998127:0:18706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788612748.998139:0:18706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788612748.998146:0:18706:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:0.0:1788612749.014976:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932328832:12345-0@lo:8:kworker.0 Request processed in 33967us (34258us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612749.014990:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788612749.018320:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612749.018333:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612749.018339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932328832:0@lo:8:kworker.0 00002000:00010000:1.0:1788612749.043824:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612749.043837:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.043855:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=563s v=(0 0) 00010000:00010000:1.0:1788612749.043860:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612749.043866:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.043885:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.043896:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.043904:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.043924:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612749.048510:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612749.048523:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048540:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1788612749.048545:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612749.048551:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048568:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048578:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048585:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048618:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788612749.048630:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612749.048636:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048643:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612749.048648:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048658:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048674:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048683:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004afab0fd/0x1f8616bf0bc93af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048701:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612749.048704:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048710:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612749.048713:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048732:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048761:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048768:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b4b5e41/0x1f8616bf0bc93b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.048782:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.048784:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.048785:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612749.049334:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612749.049341:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049351:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1788612749.049355:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612749.049368:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049379:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049387:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049401:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049417:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612749.049425:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612749.049429:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049436:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612749.049439:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049447:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049458:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049465:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d388c8/0x1f8616bf0bc93bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049499:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.049501:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.049503:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612749.049844:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612749.049861:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049869:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1788612749.049873:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612749.049877:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049886:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049895:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049902:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.049920:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612749.050294:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612749.050300:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.050309:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1788612749.050312:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612749.050316:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.050326:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.050340:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.050347:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.050355:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788612749.051767:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612749.051778:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051790:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.051795:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051815:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051832:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051840:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820cf935/0x1f8616bf0bc93c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051865:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.051869:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051876:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.051879:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051888:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051899:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.051907:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfa8081/0x1f8616bf0bc93cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612749.051933:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612749.051933:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.051936:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.051940:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.051942:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.051954:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1788612749.051958:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612749.051963:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.051973:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.051982:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.051989:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.052023:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612749.052294:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.052299:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.052307:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.052310:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.052317:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.052329:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.052336:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f617aca/0x1f8616bf0bc93d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.052352:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.052353:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.052356:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612749.052385:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612749.052459:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612749.052465:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.052843:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1788612749.052848:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612749.052854:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.052866:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.052874:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.052881:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.053022:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612749.053353:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612749.053368:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.053376:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612749.053380:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.053397:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.053409:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.053415:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc93d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612749.053430:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.053431:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.053433:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612749.054315:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612749.054325:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.054348:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=563s v=(0 0) 00010000:00010000:3.0:1788612749.054351:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612749.054357:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.054380:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.054389:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.054397:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.054423:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612749.054938:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.054944:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.054959:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.054963:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.054972:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.054985:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.054993:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa587dc6/0x1f8616bf0bc93e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.055012:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.055014:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.055015:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612749.055699:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612749.055707:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.055717:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=563s v=(0 0) 00010000:00010000:3.0:1788612749.055721:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612749.055726:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.055736:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.055815:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.055821:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.056000:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612749.060381:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.060396:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.060411:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.060415:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.060421:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.060434:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.060444:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.060451:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063290:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612749.063305:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063317:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.063321:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063332:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063375:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063383:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c912ae04/0x1f8616bf0bc93e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063404:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.063407:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063413:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.063416:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063422:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063431:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.063438:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.063440:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.063441:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612749.063839:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.063958:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612749.063966:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077fd951d/0x1f8616bf0bc93ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612749.066983:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.066995:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067017:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.067022:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.067028:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067044:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067055:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067062:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067081:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612749.067092:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.067097:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067105:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.067109:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067118:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067146:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067154:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3e9d415/0x1f8616bf0bc93f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067182:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.067184:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.067186:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.067546:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.067552:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067561:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.067564:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.067568:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067578:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067585:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067593:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067623:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612749.067933:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.067939:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067947:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.067949:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.067953:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067962:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067970:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067976:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.067988:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612749.067995:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612749.067999:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068006:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.068015:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068024:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068037:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068044:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c707eb3/0x1f8616bf0bc93fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068057:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.068060:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068067:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.068070:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068077:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068087:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068093:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e96c550/0x1f8616bf0bc9403 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068113:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.068115:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.068117:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.068525:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.068531:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068539:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.068542:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.068547:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068556:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068564:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068572:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.068588:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612749.068795:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612749.068801:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.068808:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612749.068811:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.068819:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.068831:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.068838:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000207b0f89/0x1f8616bf0bc940a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.068865:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612749.068866:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612749.068868:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.069035:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.069107:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.069113:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.069131:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.069133:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.069138:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.069147:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.069155:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.069162:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.069238:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612749.069619:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612749.069624:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.069633:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612749.069637:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.069647:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.069660:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.069668:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ccc2c7/0x1f8616bf0bc9411 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612749.069682:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612749.069684:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612749.069685:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612749.072728:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612749.072743:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.072777:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=563s v=(0 0) 00010000:00010000:1.0:1788612749.072782:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612749.072789:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.072804:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.072815:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.072823:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.072848:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612749.073367:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.073376:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073385:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.073390:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073400:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073428:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073435:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a8673c/0x1f8616bf0bc9418 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073454:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.073456:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.073459:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.073900:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.073907:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073919:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.073922:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.073926:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073935:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073943:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073949:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.073977:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612749.074929:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.074938:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.074949:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.074953:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.074957:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.074968:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.074977:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.074983:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075000:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612749.075009:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612749.075015:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075022:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.075032:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075041:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075056:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075064:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25f0f3f/0x1f8616bf0bc941f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075084:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.075087:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075093:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.075096:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075103:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075112:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075119:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ffa6ee/0x1f8616bf0bc9426 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.075139:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.075141:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.075142:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612749.075692:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.076453:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.076462:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076490:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.076495:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.076500:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076511:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076521:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076529:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076543:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612749.076551:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.076556:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076574:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.076577:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076587:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076599:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076607:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f12cdbd/0x1f8616bf0bc942d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.076622:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.076624:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.076626:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.077186:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.077193:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077203:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.077206:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.077211:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077221:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077238:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077244:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077268:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612749.077633:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.077639:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077647:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.077650:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.077654:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077662:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077669:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077676:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077699:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612749.077707:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612749.077713:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077720:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.077724:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077732:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077743:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077763:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b2f6445/0x1f8616bf0bc9434 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077780:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.077783:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077788:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.077791:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077810:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077821:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077829:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a85738c7/0x1f8616bf0bc943b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.077841:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.077842:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.077844:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.078157:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.078164:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078185:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.078189:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.078194:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078202:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078209:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078228:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078241:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612749.078249:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.078252:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078259:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.078262:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078270:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078280:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078288:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9442 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078301:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.078303:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.078304:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.078616:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.078622:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078635:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.078638:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.078642:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078651:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078658:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078665:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078677:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612749.078684:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612749.078687:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078693:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612749.078697:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078704:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078724:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078731:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9449 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.078745:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.078859:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.078882:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.078885:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.079145:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.079152:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079161:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.079164:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.079223:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079234:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079242:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079250:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079282:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612749.079614:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.079620:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.079628:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.079631:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.079640:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.079659:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.079666:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e2bb645/0x1f8616bf0bc9450 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.079681:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.079683:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.079685:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.079873:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.079879:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079888:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.079891:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.079896:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079905:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079913:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079920:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.079971:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612749.080312:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.080318:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.080327:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.080336:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.080342:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.080350:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.080367:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.080375:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083609:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612749.083620:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.083628:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612749.083631:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.083637:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083645:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083660:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083665:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9457 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083758:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.083763:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083920:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.083925:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083934:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083944:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083951:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed10ff1/0x1f8616bf0bc945e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.083965:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.083967:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.083969:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.083976:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612749.084320:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612749.084328:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.084340:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1788612749.084344:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612749.084350:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.084373:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.084383:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612749.084397:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.087589:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612749.087601:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.087615:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612749.087627:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.087640:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.087661:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612749.087672:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.087675:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612749.087679:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612749.090302:0:18706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612749.090314:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d1ab7ef/0x1f8616bf0bc9465 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788612749.090449:0:18706:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788612749.090686:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17223:x1875495932329984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105593us (107676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612749.090695:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612749.090822:0:17223:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875495932329984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788612749.090836:0:17223:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788612749.090876:0:17223:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875495932330112:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788612749.090909:0:17223:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612749.090938:0:17223:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612749.090978:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330112 00000100:00100000:3.0:1788612749.090984:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330112 00000100:00100000:3.0:1788612749.091048:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612749.091065:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17223:x1875495932330112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788612749.091096:0:19152:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788612749.097968:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788612749.098017:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788612749.098288:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17223:x1875495932330112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7220us (7372us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788612749.098299:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612749.098390:0:17223:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788612749.098399:0:17223:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875495932330112:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788612749.098413:0:17223:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1788612749.231652:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612749.296608:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932330240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612749.296676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612749.296729:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330240 00000100:00100000:1.0:1788612749.296736:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330240 00000100:00100000:1.0:1788612749.296776:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612749.296784:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932330240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612749.296805:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788612749.296848:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932330240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612749.296855:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612749.296903:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932330240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612749.301051:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932330368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612749.301126:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612749.301189:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330368 00000100:00100000:2.0:1788612749.301197:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330368 00000100:00100000:2.0:1788612749.301242:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788612749.301250:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932330368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612749.301294:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788612749.301338:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932330368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612749.301345:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788612749.301403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932330368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612749.807844:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612749.809520:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932330496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612749.809590:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612749.809719:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330496 00000100:00100000:1.0:1788612749.809726:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330496 00000100:00100000:1.0:1788612749.809839:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612749.809854:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932330496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612749.809887:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612749.815770:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932330496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5907us (6168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612749.815786:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612749.815965:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932330496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788612750.256684:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612750.516208:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788612750.929405:0:19517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788612750.929408:0:19517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788612750.929410:0:19517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788612750.929610:0:19517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9611c7525800 00000020:01000004:2.0:1788612750.929626:0:19517:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788612750.929641:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788612750.930341:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9612fcfc19c0) 00000020:00000080:2.0:1788612750.930373:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788612750.979829:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788612750.980422:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788612750.980749:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788612750.981090:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788612750.981320:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788612750.981570:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788612750.981745:0:19517:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788612750.983982:0:19517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788612750.984266:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788612750.984283:0:19517:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612750.984302:0:19517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1f8616bf0bc9473 00000020:01000004:2.0:1788612750.984309:0:19517:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788612750.984331:0:19517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788612750.984334:0:19517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788612750.984340:0:19517:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788612750.984382:0:19517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788612750.984386:0:19517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788612750.993245:0:19517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788612750.993281:0:19517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788612750.993285:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788612750.993287:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612750.993288:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612750.993289:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612750.993290:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612750.993291:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612750.993293:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612750.993295:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612750.993296:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612750.993299:0:19517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788612750.993302:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612750.993303:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612750.993304:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612750.993305:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612750.993306:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612750.993307:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612750.993308:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612750.993309:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612750.993310:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612750.993358:0:19517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788612750.993379:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932330624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788612750.993451:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612750.993571:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612750.993612:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330624 00000100:00100000:3.0:1788612750.993620:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330624 00000100:00100000:3.0:1788612750.993698:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612750.993709:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:19517:x1875495932330624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612750.993757:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788612750.993760:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788612750.993764:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788612750.994120:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:19517:x1875495932330624:12345-0@lo:253:mount.lustre.0 Request processed in 412us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612750.994128:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788612750.994209:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932330624:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612750.994218:0:19517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788612750.994221:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612750.994222:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788612750.994223:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612750.994225:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612750.994226:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612750.994227:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612750.994228:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612750.994229:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612750.994231:0:19517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612750.994253:0:19517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9611c7525800 from lustre-OST0001 10000000:01000000:0.0:1788612750.994280:0:19517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788612750.994282:0:19517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788612750.994291:0:19517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9611c5a23380 local copy 00010000:00010000:0.0:1788612750.994299:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612750.994385:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932330752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612750.994413:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612750.994637:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612750.994702:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330752 00000100:00100000:2.0:1788612750.994707:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330752 00000100:00100000:3.0:1788612750.994865:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788612750.994874:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:19517:x1875495932330752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612750.994945:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:19517:x1875495932330752:12345-0@lo:501:mount.lustre.0 Request processed in 71us (531us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612750.994952:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788612750.995054:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932330752:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788612750.995071:0:19517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788612750.995090:0:19517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788612750.995097:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612750.995106:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612750.995133:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9611c7525800 10000000:01000000:0.0:1788612750.995138:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788612750.995144:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788612750.995146:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612750.995151:0:19517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788612750.995166:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788612750.995188:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612750.995197:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612750.995213:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612750.995227:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932330880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612750.995255:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612750.995278:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612750.995384:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932330880 00000100:00100000:3.0:1788612750.995389:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932330880 00000100:00100000:3.0:1788612750.995417:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788612750.995424:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:19517:x1875495932330880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612750.995432:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612750.995444:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc947a expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612750.995501:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc947a expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612750.995513:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc947a expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612750.995522:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240200, rc 0) 00000100:00100000:3.0:1788612750.995554:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932330880:12345-0@lo:101:mount.lustre.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612750.995560:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788612750.995719:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932330880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612750.995731:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612750.995751:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612750.996763:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788612750.997304:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612750.999245:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788612750.999293:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788612750.999309:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788612750.999327:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788612750.999340:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788612750.999363:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788612750.999389:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788612750.999394:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788612750.999635:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612750.999703:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612750.999796:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612750.999908:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331008 00000100:00100000:1.0:1788612750.999917:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331008 00000100:00100000:2.0:1788612751.000069:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788612751.000088:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612751.000250:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331008:12345-0@lo:501:mount.lustre.0 Request processed in 164us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612751.000258:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788612751.000401:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612751.000443:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612751.000517:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.000534:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612751.000962:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331136 00000100:00100000:2.0:1788612751.000967:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331136 00000100:00100000:2.0:1788612751.001002:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788612751.001009:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612751.001719:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331136:12345-0@lo:503:mount.lustre.0 Request processed in 708us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612751.001727:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612751.001839:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788612751.002278:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612751.002358:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612751.002406:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.002551:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612751.002731:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331264 00000100:00100000:2.0:1788612751.002746:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331264 00000100:00100000:2.0:1788612751.002774:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788612751.002782:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612751.003181:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331264:12345-0@lo:502:mount.lustre.0 Request processed in 398us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612751.003190:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788612751.003311:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612751.003528:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788612751.003559:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788612751.003576:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788612751.003590:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788612751.003604:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788612751.003616:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788612751.003628:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788612751.003645:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788612751.003660:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788612751.003688:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612751.003734:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.003836:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612751.003891:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331392 00000100:00100000:3.0:1788612751.003898:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331392 00000100:00100000:3.0:1788612751.003941:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788612751.003950:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612751.004072:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331392:12345-0@lo:502:mount.lustre.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.004084:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788612751.004094:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612751.004131:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788612751.004139:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788612751.005312:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788612751.005323:0:19521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788612751.005329:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.005332:0:19521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788612751.005337:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612751.005362:0:19521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9611c64bcd40) 00000020:00000080:3.0:1788612751.005389:0:19521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788612751.005394:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788612751.005466:0:19521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c7525800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788612751.005510:0:19521:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788612751.005521:0:19521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1f8616bf0bc948f 00010000:00010000:3.0:1788612751.015978:0:19521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788612751.017213:0:19521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788612751.020062:0:19521:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788612751.029688:0:19521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788612751.029702:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612751.029708:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612751.029710:0:19521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788612751.029714:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612751.029717:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612751.029718:0:19521:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788612751.029721:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788612751.029722:0:19521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788612751.029724:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612751.029726:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612751.029728:0:19521:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788612751.029730:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612751.029731:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612751.029733:0:19521:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788612751.029745:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788612751.029775:0:19521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612751.029778:0:19521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612751.029779:0:19521:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788612751.029782:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788612751.030020:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788612751.030051:0:19517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788612751.030462:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.030503:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612751.030511:0:19517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c7525800 from 1 10000000:01000000:0.0:1788612751.030515:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612751.030559:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.030568:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.030580:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612751.030604:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612751.030669:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.030708:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612751.030780:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331520 00000100:00100000:3.0:1788612751.030788:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331520 00000100:00100000:3.0:1788612751.030836:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788612751.030845:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:19517:x1875495932331520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612751.030858:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612751.030872:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9496 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612751.030896:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612751.030907:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612751.030916:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241c00, rc 0) 00000100:00100000:3.0:1788612751.030961:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331520:12345-0@lo:101:mount.lustre.0 Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.030968:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788612751.031021:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612751.031035:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612751.031045:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612751.033623:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788612751.039722:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612751.039966:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788612751.039989:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788612751.040003:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788612751.040007:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788612751.040104:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612751.040179:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.040224:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612751.040249:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331648 00000100:00100000:3.0:1788612751.040263:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331648 00000100:00100000:3.0:1788612751.040314:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788612751.040323:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612751.040455:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331648:12345-0@lo:501:mount.lustre.0 Request processed in 132us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.040463:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788612751.040530:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612751.040706:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612751.040746:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.040816:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612751.041330:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331776 00000100:00100000:3.0:1788612751.041338:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331776 00000100:00100000:3.0:1788612751.041389:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788612751.041399:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612751.041731:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331776:12345-0@lo:503:mount.lustre.0 Request processed in 332us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.041739:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788612751.044472:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788612751.046087:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612751.046193:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.046289:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.046342:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612751.046382:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932331904 00000100:00100000:3.0:1788612751.046390:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932331904 00000100:00100000:3.0:1788612751.046431:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788612751.046440:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612751.046598:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932331904:12345-0@lo:502:mount.lustre.0 Request processed in 158us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.046606:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788612751.046660:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932331904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612751.046852:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788612751.046878:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788612751.046893:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788612751.046907:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788612751.046919:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788612751.046932:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788612751.046943:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788612751.046955:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788612751.046967:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788612751.046979:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788612751.046990:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788612751.047010:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.047048:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.047076:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612751.047279:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332032 00000100:00100000:0.0:1788612751.047284:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332032 00000100:00100000:0.0:1788612751.047332:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788612751.047340:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932332032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612751.047439:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932332032:12345-0@lo:502:mount.lustre.0 Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.047446:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788612751.047967:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612751.048023:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788612751.048033:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788612751.049761:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612751.049773:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049775:0:19525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612751.049790:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c7525800 00000020:00000080:3.0:1788612751.049794:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612751.049803:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612751.049805:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049807:0:19525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788612751.049817:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612751.049821:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049822:0:19525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788612751.049825:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c7525800 00000020:00000080:3.0:1788612751.049827:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612751.049894:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612751.049898:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049899:0:19525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788612751.049901:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612751.049904:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049905:0:19525:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612751.049909:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c7525800 00000020:00000080:3.0:1788612751.049911:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612751.049927:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612751.049930:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049932:0:19525:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612751.049934:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612751.049937:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049938:0:19525:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788612751.049941:0:19525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c7525800 00000020:00000080:3.0:1788612751.049942:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612751.049961:0:19525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612751.049964:0:19525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612751.049966:0:19525:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788612751.049968:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788612751.055818:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788612751.055868:0:19517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612751.056973:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.056988:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612751.057063:0:19517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788612751.057066:0:19517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9611c7525800 10000000:01000000:0.0:1788612751.057069:0:19517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9611c7525800 10000000:01000000:0.0:1788612751.057074:0:19517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612751.057080:0:19517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9611c7525800 from 1 10000000:01000000:0.0:1788612751.057082:0:19517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612751.057131:0:19517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.057163:0:19517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.057176:0:19517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612751.057202:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612751.057467:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.057518:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788612751.061319:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332160 00000100:00100000:1.0:1788612751.061335:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332160 00000100:00100000:1.0:1788612751.061403:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612751.061414:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:19517:x1875495932332160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612751.061431:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612751.061449:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799be00/0x1f8616bf0bc94ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc94a4 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612751.061490:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799be00/0x1f8616bf0bc94ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc94a4 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612751.061513:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799be00/0x1f8616bf0bc94ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc94a4 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612751.061523:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799be00, rc 0) 00000100:00100000:1.0:1788612751.061600:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332160:12345-0@lo:101:mount.lustre.0 Request processed in 188us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.061607:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612751.061664:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612751.061682:0:19517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612751.061691:0:19517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612751.063899:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788612751.064407:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612751.064624:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788612751.064667:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788612751.064689:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788612751.064705:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788612751.064719:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788612751.064733:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788612751.064747:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788612751.064760:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788612751.064776:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788612751.064789:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788612751.064802:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788612751.064819:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788612751.064836:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788612751.064864:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788612751.064880:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788612751.064891:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788612751.064905:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788612751.064950:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788612751.064967:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788612751.064980:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788612751.064995:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788612751.065009:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788612751.065022:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788612751.065036:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788612751.065049:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788612751.065062:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788612751.065076:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788612751.065088:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788612751.065103:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788612751.065116:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788612751.065129:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788612751.065140:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788612751.065151:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788612751.065175:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788612751.065191:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788612751.065203:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788612751.065214:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788612751.065228:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788612751.065241:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788612751.065254:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788612751.065265:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788612751.065275:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788612751.065289:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788612751.065300:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788612751.065313:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788612751.065326:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788612751.065372:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788612751.065378:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788612751.065463:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612751.065558:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.065608:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c298de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612751.065635:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332288 00000100:00100000:0.0:1788612751.065643:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332288 00000100:00100000:0.0:1788612751.065690:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788612751.065699:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612751.065812:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332288:12345-0@lo:501:mount.lustre.0 Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.065819:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788612751.066008:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612751.066038:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612751.066075:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.066101:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c298de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612751.066117:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332416 00000100:00100000:1.0:1788612751.066129:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332416 00000100:00100000:1.0:1788612751.066164:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612751.066171:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612751.066246:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332416:12345-0@lo:503:mount.lustre.0 Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.066253:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612751.066288:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788612751.066629:0:19517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612751.066702:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.066734:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.066754:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c72780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612751.066768:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332544 00000100:00100000:1.0:1788612751.066771:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332544 00000100:00100000:1.0:1788612751.066789:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788612751.066794:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.066868:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332544:12345-0@lo:502:mount.lustre.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.066879:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788612751.068896:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612751.070997:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788612751.071057:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788612751.071074:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788612751.071089:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788612751.071100:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788612751.071114:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788612751.071363:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788612751.071391:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788612751.071410:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788612751.071427:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788612751.071452:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788612751.071466:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788612751.071504:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788612751.071521:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788612751.071535:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788612751.071549:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788612751.071581:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788612751.071596:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788612751.071610:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788612751.071624:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788612751.071640:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788612751.071656:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788612751.071671:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788612751.071686:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788612751.071703:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788612751.071719:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788612751.071738:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788612751.071761:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788612751.071794:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788612751.071813:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788612751.071830:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788612751.071847:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788612751.071876:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788612751.071905:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788612751.071924:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788612751.071941:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788612751.071956:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788612751.071973:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788612751.071990:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788612751.072009:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788612751.072030:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788612751.072047:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788612751.072062:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788612751.072077:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788612751.072094:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788612751.072110:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788612751.073635:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788612751.073671:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788612751.073749:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.073828:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.073866:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c298df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612751.073894:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332672 00000100:00100000:1.0:1788612751.074323:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332672 00000100:00100000:1.0:1788612751.074389:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788612751.074398:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.074553:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332672:12345-0@lo:502:mount.lustre.0 Request processed in 152us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.074561:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788612751.074945:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612751.075216:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788612751.075244:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788612751.075272:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.075325:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.075382:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c72780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612751.075401:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332800 00000100:00100000:1.0:1788612751.075407:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332800 00000100:00100000:1.0:1788612751.075440:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788612751.075448:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612751.075556:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932332800:12345-0@lo:502:mount.lustre.0 Request processed in 107us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.075563:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788612751.075601:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932332800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612751.075633:0:19517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788612751.075640:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788612751.082513:0:19530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788612751.082533:0:19530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9612fb858000) 00000020:00000080:0.0:1788612751.082557:0:19530:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788612751.082649:0:19530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c7525800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612751.082653:0:19530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c7525800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612751.082655:0:19530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c7525800 3 00010000:00080000:0.0:1788612751.082683:0:19530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612c6ac1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788612751.084269:0:19530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788612751.084518:0:19530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788612751.084560:0:19530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612751.084586:0:19530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1f8616bf0bc94b9 00000100:00080000:0.0:1788612751.084599:0:19530:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612751.084605:0:19530:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9612c6ac1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612751.084640:0:19530:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed73b80 x1875495932332928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612751.084672:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932332928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612751.084737:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612751.084799:0:19530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788612751.084934:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932332928 00000100:00100000:3.0:1788612751.084942:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932332928 00000100:00100000:3.0:1788612751.084981:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612751.084990:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932332928:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788612751.085013:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:3.0:1788612751.085042:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1f8616bf0bc94c0 00000004:00100000:3.0:1788612751.085056:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612751.085091:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9611c591f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612751.085146:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875495932332928:12345-0@lo:38:llog_process_th.0 Request processed in 155us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.085153:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788612751.085192:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73b80 x1875495932332928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612751.085202:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612751.085210:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788612751.085216:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788612751.085221:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612751.085223:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612751.085228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932332928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788612751.085553:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612751.085566:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932333056:0@lo:400:kworker.0 00000100:00100000:3.0:1788612751.085602:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.086015:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333056 00000100:00080000:1.0:1788612751.086020:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788612751.086021:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333056 00000100:00080000:1.0:1788612751.086028:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612751.086032:0:15779:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612751.086037:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 563 00000100:00080000:1.0:1788612751.086041:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788612751.086047:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961300767800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612751.086063:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612751.086070:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc7480 x1875495932333312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612751.086075:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932333056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.086265:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932333056:12345-0@lo:400:kworker.0 Request processed in 194us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.086274:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788612751.086299:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788612751.086303:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932333696:0@lo:400:kworker.0 00000100:00080000:1.0:1788612751.086312:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612751.086315:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612751.086321:0:15779:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 563 00000100:00080000:1.0:1788612751.086324:0:15779:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788612751.086329:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612fccfd800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612751.086356:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.086358:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612c8ed1180 x1875495932333824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612751.086386:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612751.086395:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932333568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.086424:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.086443:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612751.086452:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932334208:0@lo:400:kworker.0 00000100:00100000:1.0:1788612751.086625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932333184:0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.086744:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.086808:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.086873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932333952:0@lo:400:kworker.0 00000100:00100000:3.0:1788612751.086899:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932333056:0@lo:400:kworker.0 00000100:00100000:1.0:1788612751.086915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932333440:0@lo:400:kworker.0 00000100:00100000:3.0:1788612751.086931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932333312:0@lo:8:kworker.0 00000100:00100000:3.0:1788612751.087727:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612751.087926:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932333824:0@lo:8:kworker.0 00000100:00100000:3.0:1788612751.087955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.088136:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333696 00000100:00100000:1.0:1788612751.088144:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333696 00000100:00100000:1.0:1788612751.088189:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333184 00000100:00100000:1.0:1788612751.088193:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333184 00000100:00100000:1.0:1788612751.088209:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333312 00000100:00100000:1.0:1788612751.088211:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333312 00000100:00100000:1.0:1788612751.088219:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333824 00000100:00100000:1.0:1788612751.088220:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333824 00000100:00100000:1.0:1788612751.088232:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612751.088240:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932333696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612751.088288:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932333696:12345-0@lo:400:kworker.0 Request processed in 48us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.088295:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612751.088310:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612751.088316:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932333184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612751.088370:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932333184:12345-0@lo:400:kworker.0 Request processed in 53us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.088377:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612751.088391:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612751.088394:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932333312:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788612751.088440:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932333312:12345-0@lo:8:kworker.0 Request processed in 44us (716us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788612751.088447:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612751.088458:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612751.088462:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932333824:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788612751.088541:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932333824:12345-0@lo:8:kworker.0 Request processed in 76us (585us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788612751.088547:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788612751.088564:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612751.089571:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333568 00000100:00100000:1.0:1788612751.089580:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333568 00000100:00100000:1.0:1788612751.089627:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612751.089635:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932333568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612751.089695:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932333568:12345-0@lo:400:kworker.0 Request processed in 61us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.089703:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612751.090306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.090338:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932333568:0@lo:400:kworker.0 00000100:00100000:2.0:1788612751.090358:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.090373:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932333696:0@lo:400:kworker.0 00000100:00100000:1.0:1788612751.090384:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932333184:0@lo:400:kworker.0 00000100:00100000:2.0:1788612751.090399:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932334080:0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.090412:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334208 00000100:00100000:0.0:1788612751.090429:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334208 00000100:00100000:2.0:1788612751.090451:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.090501:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333952 00000100:00100000:0.0:1788612751.090505:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333952 00000100:00100000:0.0:1788612751.090523:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932333440 00000100:00100000:0.0:1788612751.090526:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932333440 00000100:00080000:1.0:1788612751.090534:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612751.090538:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334080 00000100:00100000:0.0:1788612751.090541:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334080 00000100:00080000:1.0:1788612751.090560:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612751.090565:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612751.090573:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932334208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.090641:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932334208:12345-0@lo:400:kworker.0 Request processed in 67us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.090650:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612751.090667:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612751.090673:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932333952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612751.090742:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612751.090750:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612751.090755:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788612751.090759:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932333312:0@lo:8:kworker.0 00010000:00080000:1.0:1788612751.091303:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed2300 x1875495932334208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612751.091312:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932333952:12345-0@lo:400:kworker.0 Request processed in 636us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.091323:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612751.091337:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932334208:0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.091353:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612751.091363:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932333440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612751.091403:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788612751.091413:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932333440:12345-0@lo:400:kworker.0 Request processed in 51us (1071us total) trans 0 rc 0/0 00000100:00080000:3.0:1788612751.091415:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788612751.091422:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788612751.091424:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788612751.091430:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932333824:0@lo:8:kworker.0 00000100:00100000:0.0:1788612751.091439:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612751.091448:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932334080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612751.091498:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932334080:12345-0@lo:400:kworker.0 Request processed in 30us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.091506:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788612751.091545:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc5c00 x1875495932333440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612751.091556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932333440:0@lo:400:kworker.0 00010000:00080000:1.0:1788612751.091575:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed2d80 x1875495932334080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612751.091584:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932334080:0@lo:400:kworker.0 00000020:01000004:0.0:1788612751.091640:0:19530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788612751.091656:0:19530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9612fb8599c0) 00000020:00000080:0.0:1788612751.091678:0:19530:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788612751.091755:0:19530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c7525800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612751.091760:0:19530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c7525800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612751.091762:0:19530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c7525800 3 00010000:00080000:0.0:1788612751.091799:0:19530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c663f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00080000:2.0:1788612751.093543:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612c8ed3480 x1875495932333952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612751.093558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932333952:0@lo:400:kworker.0 00010000:00010000:0.0:1788612751.096051:0:19530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788612751.096355:0:19530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788612751.096400:0:19530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612751.096411:0:19530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1f8616bf0bc94ce 00000100:00080000:0.0:1788612751.096426:0:19530:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612751.096433:0:19530:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9611c663f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612751.096495:0:19530:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fed73b80 x1875495932334336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612751.096530:0:19530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788612751.096580:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932334336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788612751.096647:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612751.096703:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334336 00000100:00100000:3.0:1788612751.096711:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334336 00000040:00080000:0.0:1788612751.096826:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788612751.097034:0:19517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788612751.097068:0:19517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788612751.097085:0:19517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612751.097095:0:19517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612751.098800:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612751.098812:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932334336:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788612751.098847:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:3.0:1788612751.098887:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1f8616bf0bc94d5 00000004:00100000:3.0:1788612751.098905:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612751.099250:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9611c5919800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612751.099334:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875495932334336:12345-0@lo:38:llog_process_th.0 Request processed in 521us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612751.099343:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788612751.099414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fed73b80 x1875495932334336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612751.099425:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612751.099433:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788612751.099440:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788612751.099445:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000020:01000004:1.0:1788612751.099630:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788612751.099633:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612751.099634:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612751.099635:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612751.099637:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612751.099638:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612751.099640:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612751.099642:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612751.099643:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788612751.099648:0:19517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788612751.099650:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788612751.099652:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612751.099654:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612751.099663:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612751.099664:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612751.099666:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612751.099667:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612751.099668:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612751.099669:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788612751.099688:0:19517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788612751.099704:0:19517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932334464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788612751.099750:0:19517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.099782:0:19517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c72780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612751.099804:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334464 00000100:00100000:1.0:1788612751.099810:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334464 00000100:00100000:1.0:1788612751.099846:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612751.099854:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932334464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788612751.099881:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788612751.099896:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1788612751.100314:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c663f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612751.100322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932334336:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788612751.111120:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788612751.111143:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788612751.111582:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:19517:x1875495932334464:12345-0@lo:253:mount.lustre.0 Request processed in 11724us (11827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612751.111595:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612751.111658:0:19517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d240c1fb-ce1c-496f-9994-daecd37f5c24:19517:1875495932334464:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788612751.111672:0:19517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788612751.111675:0:19517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612751.111677:0:19517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612751.111679:0:19517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612751.111680:0:19517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612751.111682:0:19517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612751.111683:0:19517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612751.111684:0:19517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612751.111686:0:19517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612751.111688:0:19517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:0.0:1788612751.111696:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788612751.111702:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:02000000:1.0:1788612751.111704:0:19517:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788612751.111725:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.111742:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.111749:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.111757:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.111806:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.111822:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612751.111836:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932334592:0@lo:104: 00000100:00100000:0.0:1788612751.111894:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612751.111947:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.111957:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 23 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612751.112663:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932334720:0@lo:104: 00000100:00100000:0.0:1788612751.112703:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.112734:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612751.112757:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334592 00000100:00100000:0.0:1788612751.112763:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334592 00000100:00100000:0.0:1788612751.112795:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334720 00000100:00100000:0.0:1788612751.112797:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334720 00000100:00100000:0.0:1788612751.112811:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612751.112820:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:17214:x1875495932334592:12345-0@lo:104: 00010000:00010000:0.0:1788612751.112835:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.112903:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612751.112910:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:17214:x1875495932334592:12345-0@lo:104: Request processed in 91us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.112924:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612751.112944:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612751.112952:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932334720:12345-0@lo:104: 00010000:00010000:0.0:1788612751.112960:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612751.113334:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932334592:0@lo:104: 00010000:00010000:0.0:1788612751.113725:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788612751.113733:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:17214:x1875495932334720:12345-0@lo:104: Request processed in 782us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.113741:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788612751.113763:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612751.113769:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113777:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612751.113781:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113790:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788612751.113796:0:19517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 10000000:00010000:0.0:1788612751.113798:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612751.113808:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612751.113841:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113848:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612751.113876:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113895:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2897600/0x1f8616bf0bc9393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc939a expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113909:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612751.113913:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113918:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612751.113921:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113927:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612751.113933:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612751.113938:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612751.113952:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.113958:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788612751.113972:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875495932334720:0@lo:104: 00010000:00010000:1.0:1788612751.113995:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.114676:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.114687:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c799a800/0x1f8616bf0bc9385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc938c expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.114702:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612751.114711:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612751.114713:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612751.114721:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612751.114736:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932334848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612751.114789:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612751.114848:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932334976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612751.114872:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612751.115352:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334848 00000100:00100000:0.0:1788612751.115358:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932334976 00000100:00100000:1.0:1788612751.115359:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334848 00000100:00100000:0.0:1788612751.115365:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932334976 00010000:00010000:1.0:1788612751.115393:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 25 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.115393:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 25 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612751.115443:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612751.115455:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+25:3648:x1875495932334976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612751.115468:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612751.115493:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 25 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.115504:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 25 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116119:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897a00/0x1f8616bf0bc938c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9385 expref: 25 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116135:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612751.116266:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932334976:12345-0@lo:103:ldlm_bl.0 Request processed in 747us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.116274:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612751.116280:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932334976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612751.116298:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612751.116316:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:3651:x1875495932334848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612751.116325:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612751.116331:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116342:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116364:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc939a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9393 expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116377:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116386:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788612751.116401:0:17183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005067850s 00010000:00010000:0.0:1788612751.116406:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116414:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116421:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116428:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116435:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612751.116445:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116454:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.116473:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788612751.116785:0:19517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788612751.116791:0:19517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788612751.116826:0:19517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788612751.116867:0:19517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788612751.116889:0:19517:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788612751.116908:0:19517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00010000:00010000:0.0:1788612751.117288:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612751.117336:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:3651:x1875495932334848:12345-0@lo:103:ldlm_bl.0 Request processed in 1022us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612751.117356:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612751.118743:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932334848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612751.118779:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.118791:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612751.118797:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc94dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1788612751.120834:0:19517:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612751.121076:0:19517:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788612751.281949:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788612752.093508:0:19583:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612752.093801:0:19583:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788612752.303659:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788612753.011917:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612753.011925:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612c82bd800 from 10 10000000:01000000:0.0:1788612753.011930:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612753.011975:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612753.011987:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612753.012006:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612753.012032:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612753.012100:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612753.012146:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612753.012202:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335104 00000100:00100000:1.0:1788612753.012210:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335104 00000100:00100000:1.0:1788612753.012268:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788612753.012277:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932335104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612753.012290:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612753.012304:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799aa00/0x1f8616bf0bc94ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc94e3 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.012326:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799aa00/0x1f8616bf0bc94ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc94e3 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.012347:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799aa00/0x1f8616bf0bc94ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc94e3 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.012356:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799aa00, rc 0) 00000100:00100000:1.0:1788612753.012399:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932335104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612753.012406:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788612753.012952:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612753.012968:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612753.012976:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612753.013030:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788612753.013069:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612753.013100:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612753.014022:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335232 00000100:00100000:1.0:1788612753.014031:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335232 00000100:00100000:1.0:1788612753.014075:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788612753.014084:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932335232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788612753.014104:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612753.014120:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612753.014123:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788612753.014224:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932335232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612753.014233:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788612753.014329:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788612753.014408:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612753.014416:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612753.014425:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612753.014436:0:17195:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612753.014438:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c816d000 from 10 10000000:01000000:3.0:1788612753.014441:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612753.014464:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612753.014473:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612753.014505:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612753.014522:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612753.014562:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612753.014583:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612753.014634:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335360 00000100:00100000:1.0:1788612753.014639:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335360 00000100:00100000:1.0:1788612753.014671:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788612753.014678:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932335360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612753.014686:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612753.014697:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc94f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc94f1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.014715:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc94f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc94f1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.014745:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc94f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc94f1 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.014754:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a000, rc 0) 00000100:00100000:1.0:1788612753.014787:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932335360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612753.014793:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788612753.014824:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612753.014842:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.014866:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612753.014910:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788612753.014938:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612753.014952:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3706900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612753.014963:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335488 00000100:00100000:1.0:1788612753.014967:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335488 00000100:00100000:1.0:1788612753.014983:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788612753.014987:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932335488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788612753.014997:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612753.015007:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612753.015010:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788612753.015070:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932335488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612753.015076:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788612753.015167:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932335488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788612753.015209:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788612753.015215:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.015222:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612753.336240:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612754.352984:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612754.415702:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932335616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612754.415771:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612754.415984:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335616 00000100:00100000:0.0:1788612754.415992:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335616 00000100:00100000:0.0:1788612754.416106:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612754.416116:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932335616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612754.416145:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788612754.416191:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932335616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612754.416211:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788612754.416237:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612754.416301:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932335616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612754.419889:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932335744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612754.419991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612754.420523:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335744 00000100:00100000:3.0:1788612754.420534:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335744 00000100:00100000:3.0:1788612754.420592:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612754.420604:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932335744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612754.420917:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788612754.421040:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932335744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 437us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612754.421048:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612754.421211:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932335744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612754.421773:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932335872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612754.421837:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612754.425111:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932335872 00000100:00100000:3.0:1788612754.425136:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932335872 00000100:00080000:1.0:1788612754.425228:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612754.425249:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612754.425264:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932335872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612754.425298:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788612754.425419:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932335872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (3580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612754.425426:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612754.425542:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932335872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612754.932058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932336000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612754.932167:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612754.932293:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336000 00000100:00100000:0.0:1788612754.932304:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336000 00000100:00100000:0.0:1788612754.932377:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612754.932389:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932336000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612754.932435:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612754.935988:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932336000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3584us (3805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612754.936009:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612754.937976:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932336000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788612755.376028:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612755.766626:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612756.399698:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612756.464032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788612756.464086:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612756.464091:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612756.464094:0:15779:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612756.464105:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961300767800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612756.464125:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612c8ed0a80 x1875495932336512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612756.464181:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612756.464200:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932336640:0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.464263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612756.464319:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336640 00000100:00100000:2.0:1788612756.464326:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336640 00000100:00100000:2.0:1788612756.464374:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612756.464384:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932336640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.464432:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932336640:12345-0@lo:400:kworker.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.464440:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788612756.464499:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed1500 x1875495932336640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612756.464513:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932336640:0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.464735:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932336128:0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.464771:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612756.464871:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336128 00000100:00100000:2.0:1788612756.464876:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336128 00000100:00100000:2.0:1788612756.464912:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788612756.464921:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932336128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.464966:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932336128:12345-0@lo:400:kworker.0 Request processed in 47us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.464972:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788612756.466419:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932336128:0@lo:400:kworker.0 00000100:00080000:1.0:1788612756.468554:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612756.468560:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612756.468563:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612756.468575:0:15779:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612fccfd800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612756.468597:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612c8ed1f80 x1875495932337024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612756.468658:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932336256:0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.468671:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932337280:0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.468728:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.468728:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.468764:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932336896:0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.468765:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932336768:0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.468794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.468794:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.468812:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932337536:0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.470692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932337408:0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.470750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612756.470785:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337280 00000100:00100000:2.0:1788612756.470794:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337280 00000100:00100000:2.0:1788612756.470856:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337408 00000100:00100000:2.0:1788612756.470860:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337408 00000100:00100000:2.0:1788612756.470880:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612756.470888:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932337280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.470944:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932337280:12345-0@lo:400:kworker.0 Request processed in 57us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.470952:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612756.470970:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612756.470976:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932337408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.471007:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932337408:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.471013:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788612756.471046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0700 x1875495932337408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612756.471060:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932337408:0@lo:400:kworker.0 00000100:00100000:1.0:1788612756.471146:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932336384:0@lo:400:kworker.0 00000100:00100000:1.0:1788612756.471188:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.471218:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932337152:0@lo:400:kworker.0 00000100:00100000:1.0:1788612756.471238:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.471254:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932337664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612756.471275:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.471298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932336512:0@lo:8:kworker.0 00000100:00100000:1.0:1788612756.471336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.471351:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932337024:0@lo:8:kworker.0 00000100:00100000:1.0:1788612756.471383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.471411:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336896 00000100:00100000:1.0:1788612756.471415:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336896 00000100:00100000:1.0:1788612756.471435:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336384 00000100:00100000:1.0:1788612756.471438:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336384 00000100:00100000:1.0:1788612756.471450:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336512 00000100:00100000:1.0:1788612756.471452:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336512 00000100:00100000:1.0:1788612756.471459:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337024 00000100:00100000:1.0:1788612756.471461:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337024 00000100:00100000:1.0:1788612756.471470:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612756.471491:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932336896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612756.471522:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932336896:12345-0@lo:400:kworker.0 Request processed in 47us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.471528:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612756.471540:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612756.471551:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932336384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612756.471580:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932336384:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.471585:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612756.471597:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612756.471601:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932336512:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788612756.471627:0:18704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:1.0:1788612756.471653:0:18704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc94ff 00002000:00100000:1.0:1788612756.471666:0:18704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9612d1e71000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788612756.471670:0:18704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788612756.471673:0:18704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788612756.471846:0:18704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788612756.471868:0:18704:0:(import.c:65:import_set_state_nolock()) ffff9612d1e71800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612756.471903:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932336512:12345-0@lo:8:kworker.0 Request processed in 301us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.471910:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612756.471923:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612756.471927:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875495932337024:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788612756.471941:0:18704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:1.0:1788612756.471959:0:18704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9506 00002000:00100000:1.0:1788612756.471965:0:18704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9612d1e72800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788612756.471968:0:18704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788612756.471970:0:18704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788612756.471992:0:18704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788612756.472004:0:18704:0:(import.c:65:import_set_state_nolock()) ffff9612d1e70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612756.472037:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932337024:12345-0@lo:8:kworker.0 Request processed in 108us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.472043:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612756.472561:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337152 00000100:00100000:2.0:1788612756.472569:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337152 00000100:00100000:2.0:1788612756.472670:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337664 00000100:00100000:2.0:1788612756.472673:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337664 00000100:00100000:2.0:1788612756.472692:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612756.472699:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932337152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.472739:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932337152:12345-0@lo:400:kworker.0 Request processed in 41us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.472755:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612756.472769:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612756.472774:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932337664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.472807:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932337664:12345-0@lo:400:kworker.0 Request processed in 31us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.472813:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612756.472835:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612756.472883:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932336896:0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.472904:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337536 00000100:00100000:2.0:1788612756.472907:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337536 00000100:00100000:2.0:1788612756.472931:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612756.472936:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932337536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612756.472968:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932337536:12345-0@lo:400:kworker.0 Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.472973:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788612756.473004:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed3100 x1875495932337536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612756.473015:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932337536:0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.473223:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336256 00000100:00100000:3.0:1788612756.473235:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336256 00000100:00100000:3.0:1788612756.473263:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932336768 00000100:00100000:3.0:1788612756.473265:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932336768 00000100:00100000:3.0:1788612756.473279:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612756.473284:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.473339:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932336256:12345-0@lo:400:kworker.0 Request processed in 54us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612756.473345:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612756.473358:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612756.473364:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932336768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.473511:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932336768:12345-0@lo:400:kworker.0 Request processed in 147us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612756.473517:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612756.473550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932336768:0@lo:400:kworker.0 00010000:00080000:3.0:1788612756.473578:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed2680 x1875495932337280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612756.473588:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932337280:0@lo:400:kworker.0 00000100:00100000:3.0:1788612756.473612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932336256:0@lo:400:kworker.0 00000100:00080000:1.0:1788612756.473678:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612756.473683:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612756.473684:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788612756.473708:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0a80 x1875495932336512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612756.473721:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788612756.473728:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788612756.473732:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788612756.473735:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788612756.473755:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788612756.473760:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932336512:0@lo:8:kworker.0 00010000:00080000:1.0:1788612756.473772:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed1f80 x1875495932337024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612756.473780:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788612756.473785:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788612756.473787:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788612756.473789:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788612756.473807:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788612756.473810:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932337024:0@lo:8:kworker.0 00000004:00080000:3.0:1788612756.474264:0:17225:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788612756.474286:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875495932338048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788612756.474336:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612756.474358:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa8f00 going to sleep for 11 seconds 00000004:00080000:1.0:1788612756.474438:0:17943:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788612756.474457:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1875495932338176:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788612756.474502:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.474519:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a54600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612756.474545:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338048 00000100:00100000:1.0:1788612756.474551:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338048 00000100:00100000:1.0:1788612756.474588:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338176 00000100:00100000:1.0:1788612756.474592:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338176 00000100:00100000:1.0:1788612756.474613:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612756.474620:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17225:x1875495932338048:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788612756.475231:0:17942:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788612756.475328:0:17942:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 570858851516ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788612756.475336:0:17942:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788612756.475694:0:17224:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788612756.475745:0:17224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 570859268046ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788612756.475750:0:17224:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788612756.475887:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612756.475898:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1875495932338176:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788612756.476693:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612756.476716:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932337792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612756.476774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612756.476813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932337920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612756.476837:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612756.476899:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337792 00000100:00100000:3.0:1788612756.476905:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337792 00000100:00100000:3.0:1788612756.476936:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932337920 00000100:00100000:3.0:1788612756.476940:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932337920 00000100:00100000:3.0:1788612756.476953:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612756.476960:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875495932337792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612756.476984:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612756.477027:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875495932337792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612756.477035:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612756.477050:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612756.477056:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932337920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612756.477620:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612756.477660:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932337920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 603us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612756.477667:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788612756.477717:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7882680 x1875495932337792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612756.477736:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932337792:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788612756.477748:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c815ca80 x1875495932337920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612756.477759:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932337920:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788612756.483833:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612756.483894:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932336384:0@lo:400:kworker.0 00010000:00080000:1.0:1788612756.483911:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0000 x1875495932337152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612756.483923:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932337152:0@lo:400:kworker.0 00010000:00080000:1.0:1788612756.483936:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed2300 x1875495932337664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612756.483945:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932337664:0@lo:400:kworker.0 00000004:00080000:1.0:1788612756.487222:0:17931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788612756.488047:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788612756.488207:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788612756.488221:0:18707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788612756.488226:0:18707:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:1.0:1788612756.496854:0:18706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788612756.496866:0:18706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788612756.496963:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1875495932338176:12345-0@lo:7:osp-pre-1-1.0 Request processed in 21063us (22456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.496974:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788612756.497033:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880700 x1875495932338176/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612772 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612756.497047:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1875495932338176:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788612756.497062:0:17943:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788612756.497112:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1875495932338304:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788612756.497162:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.497193:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612756.499697:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338304 00000100:00100000:1.0:1788612756.499709:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338304 00000100:00100000:1.0:1788612756.499765:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612756.499774:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1875495932338304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788612756.499807:0:19152:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788612756.499885:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1875495932338304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 112us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.499893:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788612756.499935:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880700 x1875495932338304/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612772 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612756.499950:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1875495932338304:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788612756.499963:0:17943:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788612756.500002:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1875495932338432:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788612756.500034:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.500057:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612756.500082:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338432 00000100:00100000:1.0:1788612756.500086:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338432 00000100:00100000:1.0:1788612756.500110:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612756.500117:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1875495932338432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788612756.500142:0:18706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1788612756.514303:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612756.514323:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.514340:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788612756.514345:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612756.514351:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.515226:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.515247:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.515256:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.515286:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.515527:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.515535:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.515544:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.515548:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.515571:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.515592:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.515599:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f71f967/0x1f8616bf0bc950d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.515623:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.515625:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.515627:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612756.516836:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612756.516846:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516861:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788612756.516866:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612756.516871:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516891:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516901:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516910:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516929:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612756.516939:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612756.516945:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516953:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612756.516958:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516967:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516981:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.516988:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9514 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.517015:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612756.517017:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612756.517019:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.518946:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.518965:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.518979:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.518984:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.518990:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.519006:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.519017:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.519025:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.519052:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612756.520548:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612756.520560:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.520571:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612756.520576:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.520596:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.520617:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.520625:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc951b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.520643:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612756.520645:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612756.520647:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612756.525454:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612756.525466:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.525779:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788612756.525784:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612756.525790:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.525805:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.525815:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.525824:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.525879:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1788612756.528115:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788612756.528134:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788612756.528139:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788612756.528410:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.528420:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612756.528427:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17943:x1875495932338432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 28306us (28388us total) trans 8589934593 rc 0/0 00010000:00010000:2.0:1788612756.528438:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=570s v=(0 0) 00000100:00100000:0.0:1788612756.528442:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788612756.528445:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.528453:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.528469:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.528507:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.528515:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529281:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612756.529290:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529320:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.529325:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529335:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529356:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529364:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046da2287/0x1f8616bf0bc9522 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529447:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612756.529451:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529457:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.529460:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529467:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.529499:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.529511:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788612756.529513:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.529516:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.529518:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612756.529519:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9529 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.529547:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612756.529558:0:17943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788612756.529567:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1875495932338432:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788612756.529713:0:17943:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788612756.529763:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1875495932338560:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788612756.529815:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.529845:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb03d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612756.529867:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338560 00000100:00100000:1.0:1788612756.529873:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338560 00000100:00100000:1.0:1788612756.530574:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612756.531238:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1875495932338560:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788612756.531333:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1875495932338560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 105us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612756.531341:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1788612756.532780:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.532793:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.532809:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.532814:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.532821:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.532837:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.532848:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.532870:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.532889:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612756.533711:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.533719:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.533730:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.533733:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.533738:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.533748:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.533757:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.533764:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.533783:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612756.533802:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612756.533810:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.533820:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.533824:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.533846:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.533907:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.533917:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9530 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.533936:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.533939:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.533945:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.533948:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.534031:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.534042:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.534049:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f617aca/0x1f8616bf0bc9537 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.534075:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.534077:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.534079:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.534288:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.534295:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534318:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.534322:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.534327:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534339:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788612756.534343:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7880700 x1875495932338560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612772 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788612756.534353:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534365:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612756.534366:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1875495932338560:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788612756.534393:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612756.534404:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612756.534410:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534420:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.534431:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534441:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534454:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534461:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc953e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534495:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.534498:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.534500:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.534625:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.534702:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534710:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.534714:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.534718:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534728:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534747:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534754:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.534770:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612756.534792:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612756.534798:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534806:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.534810:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534818:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534829:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534891:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820cf935/0x1f8616bf0bc9545 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.534907:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.534909:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.534911:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.534937:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.535233:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.535239:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.535247:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.535250:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.535254:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.535263:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.535272:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.535279:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.538900:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612756.540183:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612756.540193:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.540207:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.540212:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.540224:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.540245:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.540253:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b4b5e41/0x1f8616bf0bc954c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.540274:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.540276:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.540278:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.541277:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.541287:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.541301:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.541305:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.541321:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.541335:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.541344:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.541350:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.541385:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612756.541444:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612756.541450:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.541458:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.541462:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.541469:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.541499:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.541506:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846c6e38/0x1f8616bf0bc9553 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.541523:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.541525:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.541526:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.542757:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.542767:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.542780:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.542790:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.542796:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.542810:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.542820:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.542827:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.542846:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612756.543509:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.543517:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.543527:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.543531:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.543535:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.543544:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.543552:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.543566:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.543653:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788612756.544698:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.544708:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544713:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612756.544724:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788612756.544724:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.544732:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.544742:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544743:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.544751:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.544759:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544764:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.544774:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.544784:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544785:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.544803:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612756.544804:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc955a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544829:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612756.544834:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544846:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.544859:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544868:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544879:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544885:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5087d9a/0x1f8616bf0bc9561 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544899:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.544902:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544909:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.544912:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544918:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544926:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544933:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37b206c/0x1f8616bf0bc9568 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.544954:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.544956:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.544958:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.548011:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.548026:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.548048:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.548053:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.548059:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.548074:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.548086:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.548095:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.548120:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.548321:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.548329:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.548339:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.548345:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.548355:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.548372:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.548381:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000919421e/0x1f8616bf0bc956f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.548404:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.548407:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.548409:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.550626:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612756.551775:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.551787:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.551804:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.551808:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.551815:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.551844:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.551856:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.551864:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.552795:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788612756.553766:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.553776:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.553790:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.553794:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.553800:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.553813:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.553823:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.553843:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555519:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612756.555533:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555563:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.555567:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555579:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555601:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555609:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9dc224/0x1f8616bf0bc9576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555710:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.555715:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555723:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ac00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.555726:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555734:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555745:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.555760:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.555762:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.555764:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.558904:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788612756.558919:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc957d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.559035:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612756.561024:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.561039:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.561057:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.561062:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.561437:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.561455:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.561467:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.561506:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.561537:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.561852:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.561860:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.561870:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.561875:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.561887:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.561906:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.561915:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc9584 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.561939:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.561941:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.561944:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612756.564411:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.564425:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.564440:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.564445:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.564451:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.564466:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.564494:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.564504:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.564523:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612756.564539:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612756.564548:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.564555:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799bc00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612756.564560:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.564569:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.564596:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.564604:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c4bfe8/0x1f8616bf0bc958b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.564621:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612756.564623:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612756.564625:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612756.566978:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612756.566991:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567006:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788612756.567010:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612756.567016:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567029:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567051:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567059:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567081:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.567289:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.567297:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.567321:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.567326:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.567336:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.567353:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.567360:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d6eb30c/0x1f8616bf0bc9592 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.567384:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.567387:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.567389:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612756.567436:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612756.567442:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567450:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788612756.567453:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612756.567457:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567466:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567473:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567497:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.567531:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.568286:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.568295:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.568304:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.568317:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.568327:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.568349:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.568357:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d97f0138/0x1f8616bf0bc9599 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.568379:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.568381:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.568383:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612756.569460:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612756.569472:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.569503:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=570s v=(0 0) 00010000:00010000:3.0:1788612756.569507:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612756.569513:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.569524:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.569533:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.569541:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.569559:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.569915:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.569923:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.569932:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.569937:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.569946:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.569962:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.569969:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000890376a3/0x1f8616bf0bc95a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570084:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.570087:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.570089:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612756.570226:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612756.570232:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570241:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788612756.570245:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612756.570250:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570260:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570267:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570274:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570300:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612756.570809:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612756.570816:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570835:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=570s v=(0 0) 00010000:00010000:0.0:1788612756.570839:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612756.570844:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570854:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570862:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570870:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570884:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612756.570892:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612756.570896:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570903:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.570906:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570914:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570936:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570943:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012bdbef1/0x1f8616bf0bc95a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570966:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.570970:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.570978:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.570982:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.571014:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.571757:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.571774:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.571782:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc95ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.571808:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.571812:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.571824:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612756.574877:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.574891:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.574907:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.574917:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.574923:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.574953:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.574964:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.574972:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.574991:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612756.575003:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612756.575008:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575016:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799ac00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612756.575021:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575031:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575047:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575077:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040bd2ab0/0x1f8616bf0bc95b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575105:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.575107:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612756.575109:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612756.575742:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.575748:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575758:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.575761:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.575765:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575775:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575785:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575792:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.575812:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612756.575822:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.575831:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.575841:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.575846:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.575855:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.575870:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.575877:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a8673c/0x1f8616bf0bc95bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.575893:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.575895:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.575897:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612756.577206:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612756.577224:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.577238:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788612756.577242:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612756.577248:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.577260:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.577269:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.577278:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612756.577302:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612756.577339:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612756.577346:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.577353:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799a800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612756.577364:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.577372:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.577384:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.577391:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f4fc738/0x1f8616bf0bc95c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612756.577408:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612756.577410:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612756.577411:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612756.579643:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612756.579658:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.579675:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=570s v=(0 0) 00010000:00010000:2.0:1788612756.579679:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612756.579685:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.579699:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.579709:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.579717:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612756.579755:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788612756.579828:0:18707:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1788612756.579934:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17225:x1875495932338048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 105310us (105593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612756.579944:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788612756.580067:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612756.580074:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.580082:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612756.580086:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.580105:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.580122:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.580130:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048697d9a/0x1f8616bf0bc95ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612756.580150:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.580152:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612756.580153:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612756.580343:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875495932338048:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788612756.580359:0:17225:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788612756.580404:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875495932338688:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788612756.580440:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612756.580473:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612feb036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612756.580496:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338688 00000100:00100000:2.0:1788612756.580502:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338688 00000100:00100000:2.0:1788612756.580547:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612756.580555:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17225:x1875495932338688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788612756.580589:0:19152:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1788612756.584146:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1875495932338688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3586us (3700us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788612756.584163:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612756.584636:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875495932338688:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788612756.584653:0:17225:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788612757.427046:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612757.895352:0:19873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788612758.449376:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788612758.856436:0:19925:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612758.856951:0:19925:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612759.472422:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612759.537199:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612759.537221:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932338816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612759.537300:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612759.537354:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338816 00000100:00100000:1.0:1788612759.537361:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338816 00000100:00100000:1.0:1788612759.537407:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612759.537415:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932338816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612759.537448:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788612759.537513:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932338816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612759.537520:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612759.537566:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932338816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612759.538420:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612759.538432:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932338944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612759.538491:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612759.538528:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932338944 00000100:00100000:0.0:1788612759.538533:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932338944 00000100:00100000:0.0:1788612759.538573:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612759.538581:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932338944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612759.538607:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788612759.538647:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932338944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612759.538653:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612759.538705:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932338944:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788612759.539763:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612759.540187:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932339072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612759.540251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612759.542372:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339072 00000100:00100000:1.0:1788612759.542386:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339072 00000100:00100000:1.0:1788612759.549003:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788612759.549037:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612759.549110:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932339072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612759.549139:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788612759.549221:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932339072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (8969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612759.549228:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612759.551023:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932339072:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1788612759.680109:0:19975:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612759.680347:0:19975:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788612759.881519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612759.881659:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425600 00000100:00100000:3.0:1788612759.881668:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425600 00000100:00100000:3.0:1788612759.881716:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:3.0:1788612759.881725:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2393:x1875495914425600:12345-192.168.203.30@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788612759.881752:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 793580fe-2c90-4d10-b55f-7f369e961e59@192.168.203.30@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1788612759.881780:0:17192:0:(genops.c:1385:class_connect()) connect: client 793580fe-2c90-4d10-b55f-7f369e961e59, cookie 0x1f8616bf0bc95d1 00000100:00080000:3.0:1788612759.881912:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9611c8056000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612759.881987:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+5:2393:x1875495914425600:12345-192.168.203.30@tcp:250:mount.lustre.0 Request processed in 262us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612759.881995:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:2.0:1788612759.885435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612759.885859:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425728 00000100:00100000:3.0:1788612759.885868:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425728 00000100:00100000:3.0:1788612759.885928:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1788612759.885939:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+5:14898:x1875495914425728:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788612759.885955:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612759.885974:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc95d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2250f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.886001:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc95d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2250f expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.886013:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc95d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2250f expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.886022:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4200, rc 0) 00000100:00100000:3.0:1788612759.886085:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+6:14898:x1875495914425728:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 148us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612759.886101:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:1.0:1788612759.893163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612759.897574:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425856 00000100:00100000:2.0:1788612759.897589:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425856 00000100:00100000:2.0:1788612759.898115:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1788612759.898129:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+6:14898:x1875495914425856:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612759.898247:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+6:14898:x1875495914425856:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 121us (5425us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612759.898267:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:0.0:1788612759.904037:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612759.907090:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914425984 00000100:00100000:1.0:1788612759.907124:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914425984 00000100:00100000:1.0:1788612759.907194:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:1.0:1788612759.907204:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+6:14898:x1875495914425984:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788612759.907220:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612759.907238:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc95df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22516 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612759.907266:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc95df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22516 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612759.907276:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc95df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22516 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612759.907295:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799ac00, rc 0) 00000100:00100000:1.0:1788612759.907419:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+7:14898:x1875495914425984:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 216us (3392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612759.907436:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:0.0:1788612759.915407:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612759.915570:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426112 00000100:00100000:2.0:1788612759.915581:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426112 00000100:00100000:2.0:1788612759.915650:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:2.0:1788612759.915660:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+7:14898:x1875495914426112:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612759.915928:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+8:14898:x1875495914426112:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 268us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612759.915936:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:0.0:1788612759.924309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612759.924392:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426240 00000100:00100000:3.0:1788612759.924401:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426240 00000100:00100000:3.0:1788612759.924463:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:3.0:1788612759.924505:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+8:14898:x1875495914426240:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788612759.924652:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+8:14898:x1875495914426240:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 180us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612759.924660:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:0.0:1788612759.935887:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612759.936328:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426368 00000100:00100000:1.0:1788612759.936340:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426368 00000100:00100000:1.0:1788612759.936398:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:1.0:1788612759.936408:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+8:14917:x1875495914426368:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612759.936586:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+8:14917:x1875495914426368:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 179us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612759.936594:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:0.0:1788612759.964363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612759.964471:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426496 00000100:00100000:2.0:1788612759.964512:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426496 00000100:00100000:2.0:1788612759.964568:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:2.0:1788612759.964578:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+8:14917:x1875495914426496:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612759.964728:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+8:14917:x1875495914426496:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 151us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612759.964737:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:0.0:1788612759.973163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612759.973260:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426624 00000100:00100000:1.0:1788612759.973269:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426624 00000100:00100000:1.0:1788612759.973337:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1788612759.973348:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+8:14917:x1875495914426624:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612759.973544:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+8:14917:x1875495914426624:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 197us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612759.973552:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:0.0:1788612759.978143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612759.978610:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426752 00000100:00100000:3.0:1788612759.978622:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426752 00000100:00100000:3.0:1788612759.978728:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:3.0:1788612759.978751:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+8:14898:x1875495914426752:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788612759.978766:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612759.978783:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc95e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22547 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.978811:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc95e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22547 expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.978821:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc95e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22547 expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.978843:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5c00, rc 0) 00000100:00100000:3.0:1788612759.978900:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+9:14898:x1875495914426752:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 150us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612759.978907:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:0.0:1788612759.985255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612759.985339:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914426880 00000100:00100000:2.0:1788612759.985349:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914426880 00000100:00100000:2.0:1788612759.985418:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:2.0:1788612759.985438:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+9:14898:x1875495914426880:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788612759.985462:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788612759.985503:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788612759.985508:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788612759.985511:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788612759.985514:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788612759.985517:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788612759.988449:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+9:14898:x1875495914426880:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 3005us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612759.988463:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:0.0:1788612759.992174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612759.992280:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427008 00000100:00100000:3.0:1788612759.992324:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427008 00000100:00100000:3.0:1788612759.992455:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:3.0:1788612759.992465:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+9:14898:x1875495914427008:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788612759.992577:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612759.992600:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2254e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.992628:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.992641:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612759.992668:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4e00, rc 0) 00000100:00100000:3.0:1788612759.992927:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+10:14898:x1875495914427008:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 462us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612759.992934:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:0.0:1788612759.995005:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612759.995158:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427136 00000100:00100000:2.0:1788612759.995167:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427136 00000100:00100000:2.0:1788612759.995262:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1788612759.995271:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+10:14898:x1875495914427136:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612759.995419:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+10:14898:x1875495914427136:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 149us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612759.995427:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:0.0:1788612759.997129:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612759.997593:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427264 00000100:00100000:1.0:1788612759.997602:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427264 00000100:00100000:1.0:1788612759.997645:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1788612759.997653:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612f7a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+10:14898:x1875495914427264:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788612759.997802:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612f7a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+10:14898:x1875495914427264:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 148us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612759.997810:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:0.0:1788612760.001401:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612760.001557:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427392 00000100:00100000:1.0:1788612760.001567:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427392 00000100:00100000:1.0:1788612760.001620:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:1.0:1788612760.001630:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+10:14923:x1875495914427392:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612760.002030:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+10:14923:x1875495914427392:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 401us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612760.002039:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:0.0:1788612760.017934:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612760.018661:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427520 00000100:00100000:2.0:1788612760.018671:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427520 00000100:00100000:2.0:1788612760.018795:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:2.0:1788612760.018806:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+10:14923:x1875495914427520:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612760.018960:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+10:14923:x1875495914427520:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 155us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612760.018967:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1788612760.023537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612760.023732:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427648 00000100:00100000:2.0:1788612760.023742:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427648 00000100:00100000:2.0:1788612760.023802:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612760.023810:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875495914427648:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788612760.023838:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a43cb079-defd-42bd-a3d5-1be09fd1336b@192.168.203.30@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:2.0:1788612760.023895:0:17200:0:(genops.c:1385:class_connect()) connect: client a43cb079-defd-42bd-a3d5-1be09fd1336b, cookie 0x1f8616bf0bc95f4 00000004:00100000:2.0:1788612760.023920:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788612760.024123:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9612fb877800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612760.024212:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2393:x1875495914427648:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 400us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612760.024220:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788612760.028985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612760.029069:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427904 00000100:00100000:1.0:1788612760.029079:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427904 00000100:00100000:1.0:1788612760.029130:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612760.029137:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875495914427904:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788612760.029169:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a43cb079-defd-42bd-a3d5-1be09fd1336b@192.168.203.30@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1788612760.029239:0:17199:0:(genops.c:1385:class_connect()) connect: client a43cb079-defd-42bd-a3d5-1be09fd1336b, cookie 0x1f8616bf0bc95fb 00000004:00100000:1.0:1788612760.029264:0:17199:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788612760.029532:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9612d1e73800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612760.029595:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2393:x1875495914427904:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 456us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612760.029603:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612760.044575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612760.044616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612760.044655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612760.044764:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428032 00000100:00100000:3.0:1788612760.044775:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428032 00000100:00100000:0.0:1788612760.044804:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914427776 00000100:00100000:0.0:1788612760.044810:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914427776 00000100:00100000:3.0:1788612760.044836:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428160 00000100:00100000:3.0:1788612760.044841:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428160 00000100:00100000:0.0:1788612760.044847:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788612760.044860:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:0:x1875495914428032:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612760.044896:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612760.044987:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:0:x1875495914428032:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.044994:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788612760.045012:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788612760.045018:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:0:x1875495914427776:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612760.045048:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788612760.045110:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:0:x1875495914427776:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 91us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.045117:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788612760.045135:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1788612760.045144:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428160:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612760.045164:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788612760.045202:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428160:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.045208:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00080000:1.0:1788612760.045687:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612760.045692:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612760.048847:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612760.048874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932339200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612760.048948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612760.049134:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339200 00000100:00100000:0.0:1788612760.049143:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339200 00000100:00100000:0.0:1788612760.049193:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612760.049202:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932339200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612760.049228:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612760.049650:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932339200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612760.049746:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932339200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 544us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.049754:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788612760.057791:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612760.058027:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428288 00000100:00100000:3.0:1788612760.058037:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428288 00000100:00100000:3.0:1788612760.058266:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788612760.058381:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428288:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788612760.058603:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428288:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 326us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612760.058611:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1788612760.062582:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612760.062612:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612760.062723:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428672 00000100:00100000:0.0:1788612760.062733:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428672 00000100:00100000:0.0:1788612760.062795:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612760.062806:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428672:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788612760.062886:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428672:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.062893:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1788612760.063705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612760.064576:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428416 00000100:00100000:3.0:1788612760.064587:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428416 00000100:00100000:1.0:1788612760.064799:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428544 00000100:00100000:1.0:1788612760.064805:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428544 00000100:00100000:1.0:1788612760.064856:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1788612760.064865:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875495914428544:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788612760.064902:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a43cb079-defd-42bd-a3d5-1be09fd1336b@192.168.203.30@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1788612760.064933:0:18707:0:(genops.c:1385:class_connect()) connect: client a43cb079-defd-42bd-a3d5-1be09fd1336b, cookie 0x1f8616bf0bc9602 00002000:00100000:1.0:1788612760.064944:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a43cb079-defd-42bd-a3d5-1be09fd1336b/ffff9612d1e76000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612760.064962:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788612760.065366:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788612760.065397:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9612d1e70000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612760.065458:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2393:x1875495914428544:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 593us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612760.065465:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612760.065787:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1788612760.065795:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875495914428416:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788612760.065829:0:18706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a43cb079-defd-42bd-a3d5-1be09fd1336b@192.168.203.30@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:0.0:1788612760.065850:0:18706:0:(genops.c:1385:class_connect()) connect: client a43cb079-defd-42bd-a3d5-1be09fd1336b, cookie 0x1f8616bf0bc9609 00002000:00100000:0.0:1788612760.065858:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a43cb079-defd-42bd-a3d5-1be09fd1336b/ffff9611c6638000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788612760.065864:0:18706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788612760.065999:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788612760.066018:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9611c663b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612760.066055:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2393:x1875495914428416:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 259us (3441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.066187:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612760.069561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612760.069660:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428800 00000100:00100000:3.0:1788612760.069669:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428800 00000100:00100000:3.0:1788612760.069728:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788612760.069739:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428800:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788612760.071431:0:17201:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1598us 00000004:00200000:0.0:1788612760.106345:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788612760.106492:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14898:x1875495914428800:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 36731us (36917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612760.106507:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788612760.276802:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612760.276902:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914428928 00000100:00100000:2.0:1788612760.276912:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914428928 00000100:00100000:2.0:1788612760.276976:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1788612760.276986:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14946:x1875495914428928:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1788612760.277006:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612760.277030:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bc9610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2257f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612760.277110:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9617 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612760.277124:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612760.277138:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612760.277435:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612760.277451:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612760.277532:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612760.277562:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bc9610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2257f expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612760.277580:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2257f expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612760.277588:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612760.277590:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612760.277594:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030e00, rc 0) 00000100:00100000:2.0:1788612760.277649:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:14946:x1875495914428928:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 664us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612760.277656:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:0.0:1788612760.495735:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612760.752406:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612761.519706:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612761.583727:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612761.583751:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932339456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612761.583856:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612761.583919:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339456 00000100:00100000:3.0:1788612761.583928:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339456 00000100:00100000:1.0:1788612761.583928:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932339328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612761.583972:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612761.584007:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339328 00000100:00100000:3.0:1788612761.584011:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339328 00000100:00100000:1.0:1788612761.584023:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788612761.584062:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612761.584225:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932339584:0@lo:400:kworker.0 00000100:00100000:0.0:1788612761.584247:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932339712:0@lo:400:kworker.0 00000100:00100000:2.0:1788612761.584265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612761.584298:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612761.584309:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932340096:0@lo:400:kworker.0 00000100:00100000:0.0:1788612761.584326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932340224:0@lo:400:kworker.0 00000100:00100000:2.0:1788612761.584339:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612761.584360:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932340608:0@lo:400:kworker.0 00000100:00100000:2.0:1788612761.584388:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612761.584406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612761.584432:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932340736:0@lo:400:kworker.0 00000100:00100000:2.0:1788612761.584437:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339712 00000100:00100000:2.0:1788612761.584442:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339712 00000100:00100000:0.0:1788612761.584459:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612761.584505:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340096 00000100:00100000:2.0:1788612761.584509:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340096 00000100:00100000:0.0:1788612761.584527:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788612761.584543:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932339712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612761.584594:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932339712:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612761.584643:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932339456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788612761.584662:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788612761.584696:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932339456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 663us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.584994:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340608 00000100:00100000:3.0:1788612761.584999:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340608 00000100:00100000:3.0:1788612761.585031:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340736 00000100:00100000:3.0:1788612761.585034:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340736 00000100:00100000:3.0:1788612761.585049:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788612761.585055:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932340608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.585097:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932340608:12345-0@lo:400:kworker.0 Request processed in 43us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.585104:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788612761.585120:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612761.585126:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.585159:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932340736:12345-0@lo:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.585164:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612761.585183:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932339840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612761.587561:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612761.587603:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612761.587620:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932339328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612761.587643:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612761.587685:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788612761.587712:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932340096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612761.587720:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932339328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612761.587727:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612761.587732:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788612761.587799:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340224 00000100:00100000:3.0:1788612761.587855:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612761.587895:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932340352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.587923:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612761.587928:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340224 00000100:00100000:3.0:1788612761.587943:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932340864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.587968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612761.587974:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339840 00000100:00100000:1.0:1788612761.587979:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339840 00000100:00100000:3.0:1788612761.587996:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788612761.588113:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932340096:12345-0@lo:400:kworker.0 Request processed in 57us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612761.588123:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788612761.588146:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612761.588152:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612761.588155:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612761.588498:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932339968:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.588530:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612761.588547:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932340480:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.588583:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612761.588608:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340352 00000100:00100000:3.0:1788612761.588612:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340352 00000100:00100000:3.0:1788612761.588635:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340864 00000100:00100000:3.0:1788612761.588638:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340864 00000100:00100000:3.0:1788612761.588658:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339968 00000100:00100000:3.0:1788612761.588661:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339968 00000100:00100000:3.0:1788612761.588669:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340480 00000100:00100000:3.0:1788612761.588671:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340480 00000100:00100000:3.0:1788612761.588684:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612761.588691:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932340352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.588730:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932340352:12345-0@lo:400:kworker.0 Request processed in 39us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.588736:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612761.588751:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612761.588756:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932340864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.588784:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932340864:12345-0@lo:400:kworker.0 Request processed in 28us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.588790:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612761.588801:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612761.588807:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932339968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.588930:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932339968:12345-0@lo:400:kworker.0 Request processed in 123us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.588937:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612761.588949:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788612761.588955:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932340480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.588984:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932340480:12345-0@lo:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.588997:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788612761.589012:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612761.589014:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612761.589035:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932339968:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.589045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932340480:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.589055:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932340352:0@lo:400:kworker.0 00010000:00080000:3.0:1788612761.589068:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ead80 x1875495932340864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612761.589078:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932340864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.589119:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932340096:0@lo:400:kworker.0 00010000:00080000:3.0:1788612761.589136:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e9880 x1875495932340608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612761.589146:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932340608:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.589185:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932339584 00000100:00100000:3.0:1788612761.589190:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932339584 00000100:00100000:3.0:1788612761.590020:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788612761.590031:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932339584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.590089:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932339584:12345-0@lo:400:kworker.0 Request processed in 60us (5824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612761.590096:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788612761.590139:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932339584:0@lo:400:kworker.0 00000100:00100000:2.0:1788612761.590529:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932339456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612761.590567:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932339328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612761.592558:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612761.592582:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932340224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612761.592669:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932340224:12345-0@lo:400:kworker.0 Request processed in 99us (8264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612761.592679:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612761.592698:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612761.592705:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932339840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612761.592762:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932339840:12345-0@lo:400:kworker.0 Request processed in 57us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612761.592769:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612761.593588:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932339840:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.593661:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932339712:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.593674:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932340224:0@lo:400:kworker.0 00000100:00100000:3.0:1788612761.593688:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932340736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612762.438357:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.438457:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429056 00000100:00100000:3.0:1788612762.438468:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429056 00000100:00100000:3.0:1788612762.438580:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:3.0:1788612762.438591:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:14998:x1875495914429056:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788612762.438640:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788612762.438729:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:14998:x1875495914429056:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 139us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.438737:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:2.0:1788612762.440499:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612762.444075:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612762.444325:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429184 00000100:00100000:2.0:1788612762.444336:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429184 00000100:00100000:2.0:1788612762.444419:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612762.444430:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14998:x1875495914429184:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788612762.444522:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612762.444622:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14998:x1875495914429184:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 193us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.444630:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:3.0:1788612762.445525:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612762.453082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.453210:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429312 00000100:00100000:3.0:1788612762.453227:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429312 00000100:00100000:3.0:1788612762.453337:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1788612762.453349:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14998:x1875495914429312:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788612762.453407:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788612762.453572:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612762.453590:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14998:x1875495914429312:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 241us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.453600:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1788612762.457248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.457759:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429440 00000100:00100000:3.0:1788612762.457770:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429440 00000100:00100000:3.0:1788612762.457895:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788612762.457911:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14998:x1875495914429440:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788612762.457971:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612762.458064:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:14998:x1875495914429440:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 159us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.458071:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00080000:2.0:1788612762.463311:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788612762.544125:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612762.613766:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000001:00080000:2.0:1788612762.613783:0:19518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788612762.685204:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612762.685446:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429568 00000100:00100000:2.0:1788612762.685462:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429568 00000100:00100000:2.0:1788612762.685785:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:2.0:1788612762.685802:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+10:15029:x1875495914429568:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612762.685835:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612762.685853:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc961e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22586 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612762.685884:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc961e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22586 expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612762.685894:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc961e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22586 expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612762.685902:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031000, rc 0) 00000100:00100000:2.0:1788612762.685967:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+11:15029:x1875495914429568:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 171us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.685974:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:0.0:1788612762.692444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.692887:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429696 00000100:00100000:3.0:1788612762.692905:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429696 00000100:00100000:3.0:1788612762.692990:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1788612762.693002:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+11:15029:x1875495914429696:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788612762.694037:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+11:15029:x1875495914429696:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 1030us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.694050:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1788612762.701331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612762.701515:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429824 00000100:00100000:2.0:1788612762.701600:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429824 00000100:00100000:2.0:1788612762.702166:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1788612762.702185:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+11:15029:x1875495914429824:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612762.702411:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+11:15029:x1875495914429824:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 232us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.702420:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:0.0:1788612762.708097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.708324:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914429952 00000100:00100000:3.0:1788612762.708337:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914429952 00000100:00100000:3.0:1788612762.708409:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:3.0:1788612762.708421:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+11:15036:x1875495914429952:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612762.708666:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+11:15036:x1875495914429952:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 247us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.708675:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:0.0:1788612762.746417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.751814:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430080 00000100:00100000:3.0:1788612762.751837:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430080 00000100:00100000:2.0:1788612762.756938:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1788612762.756957:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+11:15036:x1875495914430080:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612762.757181:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+11:15036:x1875495914430080:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 227us (10777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.757189:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:1.0:1788612762.767740:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612762.767858:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430208 00000100:00100000:2.0:1788612762.767873:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430208 00000100:00100000:2.0:1788612762.767950:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1788612762.767963:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+11:15036:x1875495914430208:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612762.768171:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+11:15036:x1875495914430208:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 209us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.768180:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1788612762.779116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.779224:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430336 00000100:00100000:3.0:1788612762.779239:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430336 00000100:00100000:3.0:1788612762.779322:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1788612762.779335:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+11:15029:x1875495914430336:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788612762.779359:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612762.779405:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4a00/0x1f8616bf0bc9625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d225b7 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612762.779442:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4a00/0x1f8616bf0bc9625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225b7 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612762.779455:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4a00/0x1f8616bf0bc9625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225b7 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612762.779466:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4a00, rc 0) 00000100:00100000:3.0:1788612762.779594:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+12:15029:x1875495914430336:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 262us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.779602:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1788612762.786181:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.786361:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430464 00000100:00100000:0.0:1788612762.786375:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430464 00000100:00100000:0.0:1788612762.786446:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:0.0:1788612762.786459:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+12:15029:x1875495914430464:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788612762.786548:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788612762.786583:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788612762.786587:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788612762.786591:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788612762.786594:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788612762.786596:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788612762.788804:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+12:15029:x1875495914430464:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 2330us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.788821:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:2.0:1788612762.794670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.795015:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430592 00000100:00100000:0.0:1788612762.795030:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430592 00000100:00100000:0.0:1788612762.795114:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:0.0:1788612762.795126:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+12:15029:x1875495914430592:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612762.795148:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612762.795173:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d225be expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612762.795232:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612762.795246:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612762.795257:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3400, rc 0) 00000100:00100000:0.0:1788612762.795350:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:15029:x1875495914430592:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 226us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.795582:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:1.0:1788612762.798403:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.798636:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430720 00000100:00100000:0.0:1788612762.798650:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430720 00000100:00100000:2.0:1788612762.799122:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1788612762.799139:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:15029:x1875495914430720:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612762.799373:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:15029:x1875495914430720:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 238us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.799382:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1788612762.807827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.808648:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430848 00000100:00100000:0.0:1788612762.808666:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430848 00000100:00100000:0.0:1788612762.808754:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:0.0:1788612762.808767:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c5a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:15029:x1875495914430848:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788612762.808978:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c5a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:15029:x1875495914430848:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 213us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.808986:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:3.0:1788612762.814791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.815052:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914430976 00000100:00100000:0.0:1788612762.815065:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914430976 00000100:00100000:0.0:1788612762.815242:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:0.0:1788612762.815255:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+13:15041:x1875495914430976:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612762.815474:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+13:15041:x1875495914430976:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 220us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.815595:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1788612762.819099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612762.819711:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431104 00000100:00100000:2.0:1788612762.819725:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431104 00000100:00100000:2.0:1788612762.819801:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1788612762.819813:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:15041:x1875495914431104:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612762.820026:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:15041:x1875495914431104:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 215us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.820036:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:1.0:1788612762.824890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.825132:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431232 00000100:00100000:0.0:1788612762.825145:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431232 00000100:00100000:0.0:1788612762.825209:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1788612762.825221:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875495914431232:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788612762.825272:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a37240e2-533b-4db0-8e7c-d76c26fe9abe@192.168.203.30@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:0.0:1788612762.825327:0:17199:0:(genops.c:1385:class_connect()) connect: client a37240e2-533b-4db0-8e7c-d76c26fe9abe, cookie 0x1f8616bf0bc9633 00000004:00100000:0.0:1788612762.825362:0:17199:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788612762.825690:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9611c663c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612762.825773:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2393:x1875495914431232:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 552us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.825782:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1788612762.826007:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.826321:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431488 00000100:00100000:3.0:1788612762.826328:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431488 00000100:00100000:3.0:1788612762.826370:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1788612762.826378:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875495914431488:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788612762.826401:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a37240e2-533b-4db0-8e7c-d76c26fe9abe@192.168.203.30@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1788612762.826447:0:17200:0:(genops.c:1385:class_connect()) connect: client a37240e2-533b-4db0-8e7c-d76c26fe9abe, cookie 0x1f8616bf0bc963a 00000004:00100000:3.0:1788612762.826467:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788612762.826731:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9612e9525000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612762.826786:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2393:x1875495914431488:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 407us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.826795:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612762.828400:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.828713:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431360 00000100:00100000:3.0:1788612762.828726:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431360 00000100:00100000:3.0:1788612762.828812:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:3.0:1788612762.828843:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:0:x1875495914431360:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788612762.828891:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788612762.828976:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:0:x1875495914431360:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 135us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.828985:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00080000:2.0:1788612762.829067:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612762.829748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.830780:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612762.839107:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431744 00000100:00100000:1.0:1788612762.839128:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431744 00000100:00100000:1.0:1788612762.843871:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431616 00000100:00100000:1.0:1788612762.843897:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431616 00000100:00100000:1.0:1788612762.843989:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1788612762.844002:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914431744:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612762.844049:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788612762.844158:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914431744:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 158us (14413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612762.844166:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1788612762.844187:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:1.0:1788612762.844195:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:0:x1875495914431616:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612762.844235:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612762.844278:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:0:x1875495914431616:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 71us (13493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612762.844284:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:0.0:1788612762.844494:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788612762.851704:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612762.852331:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914431872 00000100:00100000:1.0:1788612762.852346:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914431872 00000100:00100000:1.0:1788612762.852437:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1788612762.852448:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914431872:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788612762.852725:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914431872:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 278us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612762.852734:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1788612762.857751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612762.857844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612762.857885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612762.857963:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432000 00000100:00100000:2.0:1788612762.857974:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432128 00000100:00100000:3.0:1788612762.857977:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432000 00000100:00100000:2.0:1788612762.857981:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432128 00000100:00100000:2.0:1788612762.858040:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1788612762.858053:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875495914432128:12345-192.168.203.30@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788612762.858054:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1788612762.858079:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875495914432000:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612762.858130:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a37240e2-533b-4db0-8e7c-d76c26fe9abe@192.168.203.30@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1788612762.858170:0:18707:0:(genops.c:1385:class_connect()) connect: client a37240e2-533b-4db0-8e7c-d76c26fe9abe, cookie 0x1f8616bf0bc9641 00002000:00100000:3.0:1788612762.858186:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a37240e2-533b-4db0-8e7c-d76c26fe9abe/ffff9612e9520800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612762.858199:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788612762.858315:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788612762.858355:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9612e9523800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612762.858448:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2393:x1875495914432000:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 383us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612762.858456:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:0.0:1788612762.859073:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432256 00000100:00100000:0.0:1788612762.859082:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432256 00000100:00100000:0.0:1788612762.859182:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612762.859194:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914432256:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788612762.859274:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914432256:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 66us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.859282:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00010000:00080000:2.0:1788612762.859355:0:19152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a37240e2-533b-4db0-8e7c-d76c26fe9abe@192.168.203.30@tcp t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:2.0:1788612762.859385:0:19152:0:(genops.c:1385:class_connect()) connect: client a37240e2-533b-4db0-8e7c-d76c26fe9abe, cookie 0x1f8616bf0bc9648 00002000:00100000:2.0:1788612762.859395:0:19152:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a37240e2-533b-4db0-8e7c-d76c26fe9abe/ffff9612fb875800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788612762.859404:0:19152:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788612762.859516:0:19152:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788612762.859548:0:19152:0:(import.c:65:import_set_state_nolock()) ffff9612fb870000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612762.859577:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2393:x1875495914432128:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 1528us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612762.859585:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1788612762.864744:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612762.864941:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432384 00000100:00100000:0.0:1788612762.864954:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432384 00000100:00100000:0.0:1788612762.865039:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1788612762.865052:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914432384:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788612762.865163:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788612762.865285:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15029:x1875495914432384:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 235us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612762.865293:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1788612763.037247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612763.037499:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432512 00000100:00100000:1.0:1788612763.037514:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432512 00000100:00100000:1.0:1788612763.037595:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1788612763.037608:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15064:x1875495914432512:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:1.0:1788612763.037633:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612763.037675:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc964f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d225ef expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612763.037767:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612763.037782:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612763.038050:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612763.038112:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612763.038117:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612763.038145:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612763.038178:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc964f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612763.038202:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612763.038212:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:1.0:1788612763.038215:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612763.038219:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799a600, rc 0) 00000100:00100000:1.0:1788612763.038316:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+7:15064:x1875495914432512:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 709us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612763.038323:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:3.0:1788612763.567722:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612764.591911:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612764.656833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932340992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612764.656916:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612764.657184:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932340992 00000100:00100000:0.0:1788612764.657203:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932340992 00000100:00100000:0.0:1788612764.657269:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612764.657280:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932340992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612764.657307:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788612764.657355:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932340992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612764.657363:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612764.657380:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932341120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612764.657418:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612764.657455:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612764.657469:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341120 00000100:00100000:1.0:1788612764.657473:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341120 00000100:00100000:1.0:1788612764.657537:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612764.657544:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932341120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612764.657555:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788612764.657596:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932341120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612764.657618:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612764.657916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932341120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612764.658112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932340992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612764.658163:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932341248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612764.658199:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612764.658293:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341248 00000100:00100000:2.0:1788612764.658298:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341248 00000100:00100000:2.0:1788612764.658336:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612764.658345:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932341248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612764.658372:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788612764.658408:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932341248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612764.658414:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612764.658445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932341248:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788612764.658929:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612765.167669:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612765.167802:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932341376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612765.167867:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612765.168032:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341376 00000100:00100000:3.0:1788612765.168041:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341376 00000100:00100000:3.0:1788612765.168098:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612765.168112:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932341376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612765.168147:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788612765.168194:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932341376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612765.168201:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612765.170660:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932341376:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788612765.540193:0:20073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788612765.617904:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788612765.683623:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00100000:3.0:1788612765.683634:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000001:00100000:2.0:1788612765.686591:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00100000:2.0:1788612765.686606:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000001:00100000:1.0:1788612765.687202:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00100000:1.0:1788612765.687209:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000040:00080000:3.0:1788612766.000119:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788612766.642000:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612766.704086:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932341504:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704162:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704201:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932342016:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704224:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704251:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932342528:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704272:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704289:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932343040:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704312:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704333:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788612766.704339:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704359:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704375:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932342400:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704393:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704408:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932342912:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704427:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932341632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704518:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932342144:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704540:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704556:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932342656:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704574:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704586:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788612766.704591:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932341760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704654:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c76e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932342784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704685:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612766.704710:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342016 00000100:00100000:2.0:1788612766.704716:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342016 00000100:00100000:2.0:1788612766.704749:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342528 00000100:00100000:2.0:1788612766.704752:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342528 00000100:00100000:2.0:1788612766.704762:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932343040 00000100:00100000:2.0:1788612766.704764:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932343040 00000100:00100000:2.0:1788612766.704786:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342912 00000100:00100000:2.0:1788612766.704789:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342912 00000100:00100000:2.0:1788612766.704800:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342656 00000100:00100000:2.0:1788612766.704802:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342656 00000100:00100000:2.0:1788612766.704813:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342784 00000100:00100000:2.0:1788612766.704816:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342784 00000100:00100000:2.0:1788612766.704847:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612766.704857:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932342016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704903:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932342016:12345-0@lo:400:kworker.0 Request processed in 48us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.704909:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612766.704925:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612766.704930:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932342528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704954:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c76eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932342528:12345-0@lo:400:kworker.0 Request processed in 24us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.704959:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612766.704970:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612766.704975:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932343040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.704999:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932343040:12345-0@lo:400:kworker.0 Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705011:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612766.705024:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612766.705029:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932342912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705055:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932342912:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705060:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612766.705072:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788612766.705078:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932342656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705107:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932342656:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705112:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788612766.705124:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612766.705130:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932342784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705160:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932342784:12345-0@lo:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705165:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612766.705191:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341888 00000100:00100000:2.0:1788612766.705194:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341888 00000100:00100000:2.0:1788612766.705212:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342400 00000100:00100000:2.0:1788612766.705215:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342400 00000100:00100000:2.0:1788612766.705226:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341760 00000100:00100000:2.0:1788612766.705229:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341760 00000100:00100000:2.0:1788612766.705251:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342272 00000100:00100000:2.0:1788612766.705254:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342272 00000100:00100000:2.0:1788612766.705267:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612766.705272:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932341888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705310:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932341888:12345-0@lo:400:kworker.0 Request processed in 37us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705316:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612766.705328:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612766.705334:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932342400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705358:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932342400:12345-0@lo:400:kworker.0 Request processed in 25us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705364:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612766.705374:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612766.705379:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932341760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705404:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932341760:12345-0@lo:400:kworker.0 Request processed in 26us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705410:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612766.705420:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612766.705425:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932342272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705450:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932342272:12345-0@lo:400:kworker.0 Request processed in 24us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705455:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612766.705499:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341632 00000100:00100000:2.0:1788612766.705503:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341632 00000100:00100000:2.0:1788612766.705524:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932342144 00000100:00100000:2.0:1788612766.705526:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932342144 00000100:00100000:2.0:1788612766.705538:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788612766.705544:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932341632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705646:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932341632:12345-0@lo:400:kworker.0 Request processed in 101us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705661:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788612766.705673:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788612766.705679:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932342144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705710:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932342144:12345-0@lo:400:kworker.0 Request processed in 31us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612766.705716:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788612766.705743:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612766.705747:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612766.705749:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612766.705751:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612766.705797:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932341760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705808:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932342272:0@lo:400:kworker.0 00010000:00080000:2.0:1788612766.705820:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76e9c00 x1875495932342784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612766.705829:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932342784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705837:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932341632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705845:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932342144:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705854:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932342656:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705890:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788612766.705901:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705910:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932342400:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705919:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932342912:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705938:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932342016:0@lo:400:kworker.0 00000100:00100000:2.0:1788612766.705947:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932342528:0@lo:400:kworker.0 00010000:00080000:2.0:1788612766.705957:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c76ead80 x1875495932343040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612766.705964:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932343040:0@lo:400:kworker.0 00000100:00100000:0.0:1788612766.706102:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932341504 00000100:00100000:0.0:1788612766.706106:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932341504 00000100:00100000:0.0:1788612766.706135:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612766.706148:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3651:x1875495932341504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612766.706187:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3651:x1875495932341504:12345-0@lo:400:kworker.0 Request processed in 40us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612766.706193:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612766.706226:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612766.706235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932343168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612766.706277:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612766.706306:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932343168 00000100:00100000:0.0:1788612766.706310:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932343168 00000100:00100000:0.0:1788612766.706335:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612766.706342:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932343168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612766.706362:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612766.706394:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932343168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612766.706400:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612766.706430:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932343168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612766.706458:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c76eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932341504:0@lo:400:kworker.0 00000100:00100000:3.0:1788612766.707947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612766.707963:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932343296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612766.708014:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612766.708052:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932343296 00000100:00100000:3.0:1788612766.708058:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932343296 00000100:00100000:3.0:1788612766.708095:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612766.708103:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932343296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612766.708118:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612766.708154:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932343296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612766.708161:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612766.708201:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932343296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612767.668026:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612768.344752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.344903:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.344936:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.344960:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.344981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.345012:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.345030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.345056:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.345190:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612768.345223:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432768 00000100:00100000:3.0:1788612768.345241:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432768 00000100:00100000:3.0:1788612768.345293:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432896 00000100:00100000:3.0:1788612768.345296:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432896 00000100:00100000:3.0:1788612768.345308:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433280 00000100:00100000:3.0:1788612768.345311:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433280 00000100:00100000:3.0:1788612768.345321:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433408 00000100:00100000:3.0:1788612768.345324:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433408 00000100:00100000:3.0:1788612768.345338:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1788612768.345348:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2395:x1875495914432768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612768.345422:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2395:x1875495914432768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612768.345429:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1788612768.345445:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1788612768.345451:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914432896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612768.345507:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914432896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612768.345515:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:1.0:1788612768.345527:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1788612768.345540:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2395:x1875495914433280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612768.345580:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2395:x1875495914433280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.346319:0:17198:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788612768.346329:0:17198:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788612768.346346:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433024 00000100:00100000:2.0:1788612768.346351:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433024 00000100:00100000:2.0:1788612768.346378:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433152 00000100:00100000:2.0:1788612768.346382:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433152 00000100:00100000:2.0:1788612768.346397:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433536 00000100:00100000:2.0:1788612768.346399:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433536 00000100:00100000:2.0:1788612768.346413:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433664 00000100:00100000:2.0:1788612768.346415:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433664 00000100:00100000:2.0:1788612768.346432:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788612768.346440:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914433024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612768.346500:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914433024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.346507:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788612768.346536:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1788612768.346543:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914433152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612768.346566:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914433152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.346573:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1788612768.346594:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1788612768.346600:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914433536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612768.346625:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914433536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.346631:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1788612768.346643:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1788612768.346649:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914433664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612768.346670:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914433664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.346676:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:2.0:1788612768.346720:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612768.346724:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612768.346726:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612768.346729:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612768.348592:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914432640 00000100:00100000:0.0:1788612768.348605:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914432640 00000100:00100000:0.0:1788612768.348665:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1788612768.348674:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:2394:x1875495914432640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612768.348734:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:2394:x1875495914432640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 61us (4001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612768.348752:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:3.0:1788612768.351321:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1788612768.351342:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914433408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612768.351420:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914433408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 86us (6388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612768.351429:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:1.0:1788612768.354361:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00010000:00010000:1.0:1788612768.688894:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612768.689714:0:20221:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed9a7f2b0 20000000:00000080:0.0:1788612768.689730:0:20221:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9612e926fc00 uarg=0000000000000000 20000000:01000000:0.0:1788612768.689907:0:20221:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788612768.689913:0:20221:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788612768.689917:0:20221:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788612768.691402:0:20222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788612768.691674:0:20221:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788612768.706742:0:20221:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788612768.706938:0:20221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.706966:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.706973:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.706979:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.706985:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.706994:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707019:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707026:0:20221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707066:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707082:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.707094:0:20221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343424:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612768.707199:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707207:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.707214:0:20221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343552:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612768.707260:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707268:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.707277:0:20221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343680:0@lo:104: 00000100:00100000:1.0:1788612768.707323:0:20221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612768.707397:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.707405:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.707412:0:20221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343808:0@lo:104: 00000100:00100000:1.0:1788612768.707548:0:20221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612768.707666:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932343680 00000100:00100000:1.0:1788612768.707674:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932343680 00000100:00100000:1.0:1788612768.707709:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932343808 00000100:00100000:1.0:1788612768.707712:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932343808 00000100:00100000:1.0:1788612768.707725:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612768.707733:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:20221:x1875495932343680:12345-0@lo:104: 00010000:00010000:1.0:1788612768.707980:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.708152:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612768.708159:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+4:20221:x1875495932343680:12345-0@lo:104: Request processed in 426us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612768.708167:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612768.708197:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612768.708206:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:20221:x1875495932343808:12345-0@lo:104: 00010000:00010000:1.0:1788612768.708215:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.708266:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612768.708271:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:20221:x1875495932343808:12345-0@lo:104: Request processed in 69us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612768.708288:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788612768.708325:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612768.708337:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708349:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612768.708355:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708367:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612768.708375:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612768.708382:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788612768.708434:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708443:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612768.708469:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612768.708524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932343936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612768.708549:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9496 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc949d expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708584:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612768.708588:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708594:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612768.708597:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708605:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612768.708612:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612768.708621:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788612768.708629:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612768.708646:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708655:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612768.708664:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612768.708667:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612768.708681:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932344064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612768.708690:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b37800/0x1f8616bf0bc9338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc933f expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.708706:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612768.708708:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612768.708712:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612768.708718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612768.708758:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932343936 00010000:00010000:3.0:1788612768.708945:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612768.708951:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932343936 00010000:00010000:0.0:1788612768.709012:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 24 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.709032:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.709047:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 24 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612768.709057:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344064 00000100:00100000:1.0:1788612768.709062:0:20221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932344192:0@lo:104: 00000100:00100000:0.0:1788612768.709065:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344064 00010000:00010000:0.0:1788612768.709091:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.709107:0:20221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612768.709113:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612768.709125:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+25:3650:x1875495932343936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612768.709140:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788612768.709142:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344192 00010000:00010000:0.0:1788612768.709148:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.709151:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344192 00010000:00010000:0.0:1788612768.709166:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.709190:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612768.709197:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612768.709209:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:20221:x1875495932344192:12345-0@lo:104: 00010000:00010000:1.0:1788612768.709218:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612768.709316:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788612768.709323:0:17185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788612768.709467:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612768.709499:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+25:3650:x1875495932344064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612768.709511:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612768.709523:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.709544:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.709561:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612768.713030:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612768.713047:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:20221:x1875495932344192:12345-0@lo:104: Request processed in 3837us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612768.713058:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788612768.713151:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 25 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.713166:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.713180:0:20221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932344320:0@lo:104: 00000100:00100000:1.0:1788612768.713245:0:20221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612768.713288:0:20221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea1d3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788612768.713314:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7241c00/0x1f8616bf0bc949d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9496 expref: 25 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.713328:0:20221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343680:0@lo:104: 00010000:00010000:1.0:1788612768.713339:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b36e00/0x1f8616bf0bc933f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9338 expref: 24 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.713346:0:20221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343808:0@lo:104: 00000100:00100000:1.0:1788612768.713354:0:20221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932344192:0@lo:104: 00000100:00100000:1.0:1788612768.713555:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932343936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612768.713883:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:3650:x1875495932343936:12345-0@lo:103:ldlm_bl.0 Request processed in 4751us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612768.713900:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788612768.713959:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612768.713969:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.713980:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612768.713985:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.714009:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612768.714155:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612768.714163:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788612768.714238:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.714246:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612768.714280:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.714288:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c2896800/0x1f8616bf0bc92f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9300 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.714302:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612768.714304:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612768.714306:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612768.714327:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612768.714348:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932344448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612768.714396:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612768.714466:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788612768.714505:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344448 00000100:00100000:0.0:1788612768.714514:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344448 00010000:00010000:0.0:1788612768.714788:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 23 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612768.714829:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788612768.714842:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612768.714854:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:3649:x1875495932344448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612768.714871:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612768.714880:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 23 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.714905:0:20221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343424:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612768.714909:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 23 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.714926:0:20221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932343552:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612768.714938:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799b400/0x1f8616bf0bc9300 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc92f9 expref: 23 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612768.714958:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612768.715045:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:3649:x1875495932344448:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612768.715054:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612768.715082:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344320 00000100:00100000:2.0:1788612768.715093:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344320 00000100:00100000:2.0:1788612768.715146:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612768.715155:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:20221:x1875495932344320:12345-0@lo:104: 00010000:00010000:2.0:1788612768.715170:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612768.715416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612768.717010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932344448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612768.717318:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612768.717327:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d240c1fb-ce1c-496f-9994-daecd37f5c24+3:20221:x1875495932344320:12345-0@lo:104: Request processed in 2172us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.717337:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612768.717397:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3650:x1875495932344064:12345-0@lo:103:ldlm_bl.0 Request processed in 7922us (8686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.717405:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612768.717425:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433792 00000100:00100000:2.0:1788612768.717432:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433792 00010000:00010000:2.0:1788612768.717461:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 13 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612768.717507:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1788612768.717516:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914433792:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612768.717529:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612768.717535:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 13 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.717560:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 13 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.717578:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc962c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225be expref: 13 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.717592:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612768.717637:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:793580fe-2c90-4d10-b55f-7f369e961e59+12:2395:x1875495914433792:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 122us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612768.717644:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788612768.717908:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932344064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612768.719559:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612768.719581:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.719591:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612768.719595:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.719605:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612768.719613:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612768.719619:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612768.719668:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.719674:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612768.719708:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.719715:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b37a00/0x1f8616bf0bc92eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc92f2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612768.719735:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612768.719737:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612768.719739:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612768.719923:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932344576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612768.720001:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612768.720064:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344576 00000100:00100000:1.0:1788612768.720071:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344576 00010000:00010000:1.0:1788612768.720099:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.720131:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612768.720147:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3649:x1875495932344576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612768.720161:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612768.720166:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.720176:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.720192:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612768.720241:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3649:x1875495932344576:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612768.720249:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612768.720284:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932344576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612768.720810:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612768.720897:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914433920 00000100:00100000:1.0:1788612768.720905:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914433920 00010000:00010000:1.0:1788612768.720931:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612768.720976:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1788612768.720987:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+12:2395:x1875495914433920:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612768.720997:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612768.721003:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721015:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721027:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4e00/0x1f8616bf0bc95ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2254e expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721052:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721060:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721076:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721082:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721089:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721095:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721100:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612768.721104:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721112:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721120:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612768.721129:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612768.721182:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+11:2395:x1875495914433920:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612768.721195:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00010000:00010000:3.0:1788612768.721944:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897200/0x1f8616bf0bc92f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc92eb expref: 20 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612768.721960:0:20221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1875495932344320:0@lo:104: 00010000:00010000:3.0:1788612768.721994:0:20221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612768.722087:0:20221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612768.722095:0:20221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612768.722102:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799b000/0x1f8616bf0bc965d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788612768.762546:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00010000:00010000:3.0:1788612769.713620:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612769.775658:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932344704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612769.775724:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612769.775841:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932344960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612769.775869:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612769.775904:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344704 00000100:00100000:0.0:1788612769.775910:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344704 00000100:00100000:2.0:1788612769.775915:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612769.775926:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932344832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612769.775950:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344960 00000100:00100000:0.0:1788612769.775954:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344960 00000100:00100000:2.0:1788612769.775959:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612769.775972:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612769.775982:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932344704:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788612769.776061:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788612769.776077:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788612769.776123:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932344704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612769.776129:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612769.776144:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612769.776151:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932344960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612769.776269:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788612769.776305:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932344960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612769.776311:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612769.776347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932344960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612769.779354:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932344704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612769.779988:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932344832 00000100:00100000:3.0:1788612769.779996:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932344832 00000100:00100000:3.0:1788612769.780153:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612769.780165:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932344832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612769.780248:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788612769.780330:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932344832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612769.780338:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612769.780385:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932344832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612769.946289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612769.946455:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434048 00000100:00100000:1.0:1788612769.946465:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434048 00000100:00100000:1.0:1788612769.946542:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:1.0:1788612769.946551:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+11:14912:x1875495914434048:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612769.946567:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612769.946587:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9664 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d225f6 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612769.946614:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225f6 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612769.946625:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225f6 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612769.946633:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c799bc00, rc 0) 00000100:00100000:1.0:1788612769.946750:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+12:14912:x1875495914434048:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 199us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612769.946756:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:0.0:1788612769.957959:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612769.960499:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434176 00000100:00100000:3.0:1788612769.960517:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434176 00000100:00100000:3.0:1788612769.960589:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1788612769.960601:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+12:14912:x1875495914434176:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612769.960774:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+12:14912:x1875495914434176:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 175us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612769.960783:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1788612769.964954:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612769.965034:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434304 00000100:00100000:0.0:1788612769.965052:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434304 00000100:00100000:0.0:1788612769.965106:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:0.0:1788612769.965116:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+12:14912:x1875495914434304:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612769.965271:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+12:14912:x1875495914434304:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 156us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612769.965278:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:3.0:1788612769.974600:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612769.974639:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434432 00000100:00100000:3.0:1788612769.974718:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434432 00000100:00100000:3.0:1788612769.974770:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1788612769.974780:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+12:14912:x1875495914434432:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612769.974796:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612769.974814:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc966b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d225fd expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612769.974841:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc966b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225fd expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612769.974852:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc966b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225fd expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612769.974861:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5e00, rc 0) 00000100:00100000:3.0:1788612769.974912:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:14912:x1875495914434432:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 134us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612769.974919:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1788612769.977723:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612769.977758:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434560 00000100:00100000:3.0:1788612769.977766:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434560 00000100:00100000:3.0:1788612769.977813:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1788612769.977823:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c29f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:14912:x1875495914434560:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612769.977957:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c29f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:14912:x1875495914434560:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 134us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612769.977965:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1788612769.986374:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612769.986500:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434688 00000100:00100000:3.0:1788612769.986510:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434688 00000100:00100000:3.0:1788612769.986561:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:3.0:1788612769.986571:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c32b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:14912:x1875495914434688:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612769.988263:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c32b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+13:14912:x1875495914434688:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 1685us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612769.988276:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 10000000:01000000:1.0:1788612770.031571:0:17195:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612770.031580:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c7525800 from 13 10000000:01000000:1.0:1788612770.031585:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612770.031633:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612770.031655:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612770.031685:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612770.031709:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612770.031775:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612770.031821:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea1dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612770.031923:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345088 00000100:00100000:0.0:1788612770.031930:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345088 00000100:00100000:0.0:1788612770.031986:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788612770.031997:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c65fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:17195:x1875495932345088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612770.032010:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612770.032033:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3200/0x1f8616bf0bc9679 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9672 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.032176:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3200/0x1f8616bf0bc9679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9672 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.032186:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3200/0x1f8616bf0bc9679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9672 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.032195:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3200, rc 0) 00000100:00100000:0.0:1788612770.032258:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c65fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932345088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.032265:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788612770.032311:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612770.032326:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.032334:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612770.032396:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.032423:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.032439:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612770.032452:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345216 00000100:00100000:0.0:1788612770.032456:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345216 00000100:00100000:0.0:1788612770.032510:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788612770.032517:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c65f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932345216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.032618:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c65f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932345216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.032625:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788612770.032735:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.032763:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.032804:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.032819:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612770.032829:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345344 00000100:00100000:0.0:1788612770.032832:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345344 00000100:00100000:0.0:1788612770.032859:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788612770.032865:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932345344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.032941:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932345344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.032947:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788612770.032985:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788612770.041423:0:20286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788612770.041554:0:17195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788612770.041580:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612770.041592:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.041603:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612770.041619:0:17195:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612770.041622:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612fe89a000 from 13 10000000:01000000:0.0:1788612770.041625:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612770.041666:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.041675:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.041686:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612770.041711:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.041773:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.041829:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612770.041900:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345472 00000100:00100000:2.0:1788612770.041907:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345472 00000100:00100000:3.0:1788612770.043283:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788612770.043300:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:17195:x1875495932345472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612770.043318:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612770.043335:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc9687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9680 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.043360:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc9687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9680 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.043371:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc9687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9680 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.043391:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4400, rc 0) 00000100:00100000:3.0:1788612770.043467:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932345472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612770.043494:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788612770.044179:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612770.044200:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612770.044212:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612770.044306:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ada680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612770.044351:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612770.045252:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612770.045306:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345600 00000100:00100000:0.0:1788612770.045313:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345600 00000100:00100000:0.0:1788612770.045356:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788612770.045364:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932345600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.045704:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932345600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.045712:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788612770.046397:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ada680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612770.046451:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612770.046590:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612770.046615:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea1de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612770.046636:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345728 00000100:00100000:1.0:1788612770.046641:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345728 00000100:00100000:1.0:1788612770.046678:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788612770.046686:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932345728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612770.046785:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932345728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612770.046791:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788612770.046834:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612770.048515:0:20288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788612770.048780:0:17195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788612770.048806:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612770.048817:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.048827:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612770.048838:0:17195:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612770.048841:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612c82bd800 from 13 10000000:01000000:0.0:1788612770.048844:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612770.048879:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.048887:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.048897:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612770.048921:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.048980:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.049032:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612770.049064:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345856 00000100:00100000:0.0:1788612770.049071:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345856 00000100:00100000:0.0:1788612770.049116:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788612770.049125:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:17195:x1875495932345856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612770.049136:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612770.049149:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc968e expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.049172:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc968e expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.049183:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc968e expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.049192:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3400, rc 0) 00000100:00100000:0.0:1788612770.049239:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932345856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.049245:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788612770.049288:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612770.049301:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.049310:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612770.049363:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.049388:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.049414:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612770.049640:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932345984 00000100:00100000:3.0:1788612770.049645:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932345984 00000100:00100000:3.0:1788612770.049678:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788612770.049686:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932345984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.049790:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932345984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612770.049797:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788612770.049826:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.049854:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.049894:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612770.049909:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612770.049920:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346112 00000100:00100000:3.0:1788612770.049923:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346112 00000100:00100000:3.0:1788612770.049941:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788612770.049946:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932346112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.050019:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932346112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612770.051145:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788612770.051227:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612770.059013:0:20290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788612770.059351:0:17195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788612770.059380:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612770.059392:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.059404:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612770.059416:0:17195:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612770.059419:0:17195:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c816d000 from 13 10000000:01000000:0.0:1788612770.059422:0:17195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612770.059460:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.059469:0:17195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612770.059507:0:17195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612770.059533:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.059606:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.059651:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c88bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612770.059716:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346240 00000100:00100000:3.0:1788612770.059724:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346240 00000100:00100000:3.0:1788612770.059774:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788612770.059783:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:17195:x1875495932346240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612770.059796:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612770.059810:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613020f5200/0x1f8616bf0bc96a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc969c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.059833:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613020f5200/0x1f8616bf0bc96a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc969c expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.059843:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613020f5200/0x1f8616bf0bc96a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc969c expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.059851:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f5200, rc 0) 00000100:00100000:3.0:1788612770.059896:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932346240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612770.059902:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788612770.059947:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612770.059961:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612770.059970:0:17195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612770.060020:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.060302:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612770.060329:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0980a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612770.060380:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346368 00000100:00100000:0.0:1788612770.060385:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346368 00000100:00100000:0.0:1788612770.060419:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788612770.060427:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932346368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612770.060555:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932346368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.060573:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788612770.060775:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.060807:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612770.060848:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612770.060869:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0980a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612770.060925:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346496 00000100:00100000:2.0:1788612770.060930:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346496 00000100:00100000:2.0:1788612770.060963:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788612770.060970:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932346496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612770.061130:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:17195:x1875495932346496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612770.061137:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788612770.062175:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d240c1fb-ce1c-496f-9994-daecd37f5c24:17195:1875495932346496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788612770.068187:0:20292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788612770.070296:0:17195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788612770.070331:0:17195:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612770.070343:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612770.070356:0:17195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612770.287696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932346624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612770.287768:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612770.287869:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346624 00000100:00100000:0.0:1788612770.287877:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346624 00000100:00100000:0.0:1788612770.287929:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612770.287938:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932346624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612770.287971:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612770.288020:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932346624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612770.288027:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612770.288073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932346624:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612770.736531:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612770.992715:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612771.759782:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612771.823903:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612771.823928:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932346752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612771.823993:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.824996:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932346880:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.825044:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.825075:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932347392:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.825100:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.825120:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932347904:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.825143:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.825163:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788612771.825169:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932347264:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.825190:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.825216:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932347776:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.825237:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.825253:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932348288:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.825271:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612771.825297:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347392 00000100:00100000:3.0:1788612771.825305:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347392 00000100:00100000:3.0:1788612771.825357:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612771.825365:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932347392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.825811:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932347008:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.825845:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612771.826004:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932347520:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612771.826051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932348032:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612771.826088:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612771.826093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932347136:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612771.826126:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932347648:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826146:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612771.826160:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932348160:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826179:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612771.826221:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347008 00000100:00100000:0.0:1788612771.826235:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347008 00000100:00100000:0.0:1788612771.826263:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612771.826269:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932347008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826310:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932347008:12345-0@lo:400:kworker.0 Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612771.826317:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612771.826358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932347008:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.826395:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347904 00000100:00100000:0.0:1788612771.826399:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347904 00000100:00100000:1.0:1788612771.826411:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612771.826421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932348416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612771.826448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612771.826498:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612771.826516:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346752 00000100:00100000:1.0:1788612771.826519:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346752 00000100:00100000:2.0:1788612771.826640:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932348416 00000100:00100000:2.0:1788612771.826644:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932348416 00000100:00100000:2.0:1788612771.826673:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612771.826681:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932348416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612771.826704:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612771.826742:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932348416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612771.826749:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612771.826768:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932346880 00000100:00100000:2.0:1788612771.826772:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932346880 00000100:00100000:2.0:1788612771.826798:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612771.826804:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3651:x1875495932346880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.826845:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3651:x1875495932346880:12345-0@lo:400:kworker.0 Request processed in 41us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612771.826851:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612771.826875:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347264 00000100:00100000:2.0:1788612771.826879:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347264 00000100:00100000:1.0:1788612771.826981:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612771.826987:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932346752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612771.826998:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788612771.827039:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932346752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612771.827045:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788612771.827073:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612771.827100:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347520 00000100:00100000:1.0:1788612771.827104:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347520 00000100:00100000:1.0:1788612771.827144:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347136 00000100:00100000:1.0:1788612771.827147:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347136 00000100:00100000:1.0:1788612771.827159:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347648 00000100:00100000:1.0:1788612771.827161:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347648 00000100:00100000:1.0:1788612771.827172:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612771.827177:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932347520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612771.827223:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932347520:12345-0@lo:400:kworker.0 Request processed in 46us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612771.827229:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612771.827249:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612771.827256:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932347136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.827281:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932347392:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612771.827284:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932347136:12345-0@lo:400:kworker.0 Request processed in 29us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612771.827290:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788612771.827297:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612771.827307:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612771.827312:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932347648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.827314:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932347776 00000100:00100000:3.0:1788612771.827317:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932347776 00000100:00100000:1.0:1788612771.827339:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932347648:12345-0@lo:400:kworker.0 Request processed in 27us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612771.827344:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788612771.827363:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612771.827374:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932348288 00000100:00100000:0.0:1788612771.827378:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932348288 00000100:00100000:1.0:1788612771.827388:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932348416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612771.827433:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932347136:0@lo:400:kworker.0 00000100:00100000:1.0:1788612771.827443:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932347648:0@lo:400:kworker.0 00000100:00100000:1.0:1788612771.827454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932347520:0@lo:400:kworker.0 00000100:00080000:1.0:1788612771.827492:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612771.827514:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932348032 00000100:00100000:1.0:1788612771.827518:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932348032 00000100:00100000:2.0:1788612771.828716:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932348160 00000100:00100000:2.0:1788612771.828725:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932348160 00000100:00100000:2.0:1788612771.828758:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788612771.828767:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932347904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.828827:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932347904:12345-0@lo:400:kworker.0 Request processed in 62us (3683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612771.828834:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788612771.828850:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788612771.828858:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932347264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.828899:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932347264:12345-0@lo:400:kworker.0 Request processed in 43us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612771.828904:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788612771.828915:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788612771.828921:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932348160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.828959:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932348160:12345-0@lo:400:kworker.0 Request processed in 38us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612771.828964:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788612771.829026:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932348160:0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.829089:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932347264:0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.829100:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932346880:0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.829143:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932347392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.829154:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932347904:0@lo:400:kworker.0 00000100:00100000:2.0:1788612771.829172:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932346752:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788612771.829218:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612771.829222:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612771.830773:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612771.830791:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932347776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612771.834790:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612771.834814:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932348032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612771.834921:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932348032:12345-0@lo:400:kworker.0 Request processed in 120us (8848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612771.834929:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788612771.835893:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc727100 x1875495932348032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612771.835911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932348032:0@lo:400:kworker.0 00000100:00100000:3.0:1788612771.836449:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932347776:12345-0@lo:400:kworker.0 Request processed in 5662us (11207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612771.836459:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788612771.836626:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932347776:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.837406:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612771.837426:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932348288:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788612771.837694:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc724a80 x1875495932348288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612771.837707:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932348288:0@lo:400:kworker.0 00000100:00100000:0.0:1788612771.837749:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932348288:12345-0@lo:400:kworker.0 Request processed in 110us (12252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612771.837758:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612772.207168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.207246:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434816 00000100:00100000:2.0:1788612772.207256:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434816 00000100:00100000:2.0:1788612772.207332:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1788612772.207343:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:15581:x1875495914434816:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612772.207362:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612772.207384:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc96aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22604 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207465:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207510:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207542:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207558:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207566:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207572:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207655:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc96bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207663:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc96bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207670:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc96bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612772.207700:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612772.207704:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612772.207740:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc96bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207750:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207756:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207772:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207778:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612772.207782:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207790:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207803:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612772.207806:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612772.207811:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207816:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207830:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207836:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207841:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207845:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612772.207848:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207866:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207874:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9612c93f7c00) 00010000:00010000:2.0:1788612772.207876:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612772.207879:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207884:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207915:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc96aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22604 expref: 8 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207929:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc96bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22604 expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.207937:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9612c93f7700) 00010000:00010000:2.0:1788612772.207939:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612772.207941:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031a00, rc 0) 00000100:00100000:2.0:1788612772.208006:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:15581:x1875495914434816:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 666us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.208015:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00080000:1.0:1788612772.208439:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612772.209948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.210164:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914434944 00000100:00100000:0.0:1788612772.210174:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914434944 00000100:00100000:0.0:1788612772.210241:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788612772.210251:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:15581:x1875495914434944:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788612772.210331:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:15581:x1875495914434944:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 80us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612772.210338:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612772.225231:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612772.225337:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914435200 00000100:00100000:1.0:1788612772.225346:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914435200 00000100:00100000:1.0:1788612772.225406:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612772.225415:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:15581:x1875495914435200:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612772.225452:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612772.225507:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc96c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2260b expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.225584:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.225599:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.225610:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.225624:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.225630:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.225638:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226145:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0a00/0x1f8616bf0bc96db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226156:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0a00/0x1f8616bf0bc96db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226164:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0a00/0x1f8616bf0bc96db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612772.226173:0:20193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788612772.226348:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226356:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226361:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226367:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612772.226372:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226379:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226390:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9612c93f7700) 00010000:00010000:1.0:1788612772.226393:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612772.226397:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226403:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799b400/0x1f8616bf0bc96cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226417:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226423:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226429:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226443:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612772.226446:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226452:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226460:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9612fb831300) 00010000:00010000:1.0:1788612772.226462:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612772.226465:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.226471:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bc96d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.230059:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a800/0x1f8616bf0bc96c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2260b expref: 10 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.230088:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0a00/0x1f8616bf0bc96db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2260b expref: 9 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.230099:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9612fb831700) 00010000:00010000:1.0:1788612772.230102:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612772.230106:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0a00, rc 0) 00000100:00100000:1.0:1788612772.230181:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15581:x1875495914435200:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4765us (4958us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788612772.230191:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1788612772.235594:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.235688:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914435328 00000100:00100000:0.0:1788612772.235699:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914435328 00000100:00100000:0.0:1788612772.235764:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1788612772.235774:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15581:x1875495914435328:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788612772.235897:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15581:x1875495914435328:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612772.235904:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1788612772.251309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.251654:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914435456 00000100:00100000:0.0:1788612772.251666:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914435456 00000100:00100000:0.0:1788612772.251793:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1788612772.251806:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:15581:x1875495914435456:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788612772.253705:0:17200:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1858us 00000100:00080000:1.0:1788612772.258986:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612772.269560:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:15581:x1875495914435456:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 17746us (18249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612772.269575:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:3.0:1788612772.283797:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.283959:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914435584 00000100:00100000:2.0:1788612772.283969:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914435584 00000100:00100000:2.0:1788612772.284419:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612772.284433:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15587:x1875495914435584:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612772.284468:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612772.285156:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc96e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22612 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285237:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285252:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285264:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285281:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285288:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285294:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285329:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285336:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285342:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285349:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612772.285361:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285369:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285380:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612772.285383:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612772.285387:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285393:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc96f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285407:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285413:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285419:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285424:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612772.285426:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285431:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285438:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9612c93f7c00) 00010000:00010000:2.0:1788612772.285441:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612772.285451:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285458:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc96f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285562:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc96e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22612 expref: 10 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285574:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612772.285576:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612772.285580:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc96e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22612 expref: 10 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.285648:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030a00, rc 0) 00000100:00100000:2.0:1788612772.285710:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15587:x1875495914435584:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1280us (1922us total) trans 0 rc 301/301 00000100:00100000:2.0:1788612772.285718:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:3.0:1788612772.289307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.289376:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914435712 00000100:00100000:2.0:1788612772.289387:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914435712 00000100:00100000:2.0:1788612772.289440:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788612772.289450:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15587:x1875495914435712:12345-192.168.203.30@tcp:700:lfs.0 00000100:00100000:2.0:1788612772.289546:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15587:x1875495914435712:12345-192.168.203.30@tcp:700:lfs.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.289554:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788612772.293335:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612772.293601:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914435968 00000100:00100000:3.0:1788612772.293612:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914435968 00000100:00100000:3.0:1788612772.293695:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:3.0:1788612772.293705:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:15587:x1875495914435968:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788612772.293758:0:20193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612772.293788:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2257f expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.293825:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:3.0:1788612772.293831:0:20193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612772.293895:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.293908:0:20193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.293918:0:20193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.293950:0:20193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.293964:0:20193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 5 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612772.293976:0:20193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e9545500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20193:1875495932348544:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612772.294418:0:20193:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612772.299082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.299223:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914436096 00000100:00100000:2.0:1788612772.299232:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914436096 00010000:00010000:2.0:1788612772.299291:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 6 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612772.299350:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612772.299360:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914436096:12345-192.168.203.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788612772.299370:0:20193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e9545500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20193:1875495932348544:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612772.299374:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612772.299380:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 6 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.299392:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 6 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788612772.299425:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612772.301079:0:20193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.301112:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c799a600/0x1f8616bf0bc9656 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225ef expref: 6 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.301224:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:2.0:1788612772.301230:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.301240:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.301247:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.301318:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612772.301390:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914436096:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2029us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.301400:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00010000:00010000:1.0:1788612772.302582:0:20193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.302656:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.302686:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.302697:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.302706:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306623:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306647:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306658:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612772.306688:0:20193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037549380 reply state 000000009cad61f8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306700:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306706:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:1.0:1788612772.306709:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612772.306713:0:20193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788612772.306718:0:20193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788612772.306727:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306733:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306740:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306746:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612772.306751:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306759:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306768:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7a00) 00010000:00010000:1.0:1788612772.306770:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612772.306773:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306789:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc96fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612772.306812:0:20193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037549380 reply state 000000009cad61f8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306822:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.306828:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9612fb831300) 00010000:00010000:1.0:1788612772.306830:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612772.306832:0:20193:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788612772.307583:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+10:15587:x1875495914435968:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 13227us (13604us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788612772.307597:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1788612772.413731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.414507:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914436224 00000100:00100000:2.0:1788612772.414529:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914436224 00000100:00100000:2.0:1788612772.414595:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1788612772.414605:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+10:15595:x1875495914436224:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:2.0:1788612772.414628:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612772.414650:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22619 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.414714:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc971a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.414728:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc971a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.416518:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc971a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612772.416646:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612772.416651:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612772.416695:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc971a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.416731:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22619 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.416753:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc971a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22619 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.416763:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:2.0:1788612772.416765:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612772.416769:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030200, rc 0) 00000100:00100000:2.0:1788612772.416921:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+11:15595:x1875495914436224:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 2316us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.416930:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1788612772.442913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612772.444802:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914436352 00000100:00100000:1.0:1788612772.444816:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914436352 00000100:00100000:1.0:1788612772.445215:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1788612772.445230:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:15596:x1875495914436352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612772.445253:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612772.445276:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc9721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22620 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.445341:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1000/0x1f8616bf0bc9728 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.445355:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1000/0x1f8616bf0bc9728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.445397:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1000/0x1f8616bf0bc9728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612772.445443:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612772.445447:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612772.445467:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1000/0x1f8616bf0bc9728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.445517:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc9721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22620 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.445537:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1000/0x1f8616bf0bc9728 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22620 expref: 6 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.445547:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:1.0:1788612772.445550:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612772.445554:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1000, rc 0) 00000100:00100000:1.0:1788612772.445770:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15596:x1875495914436352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 543us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612772.445777:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1788612772.451901:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.452029:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914436480 00000100:00100000:0.0:1788612772.452040:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914436480 00000100:00100000:0.0:1788612772.452281:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1788612772.452293:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:15596:x1875495914436480:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612772.452315:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612772.452344:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc972f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22627 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452417:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452435:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452449:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452500:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452509:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452516:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452847:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3000/0x1f8616bf0bc9744 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452858:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3000/0x1f8616bf0bc9744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452876:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3000/0x1f8616bf0bc9744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612772.452915:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612772.452919:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612772.452940:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3000/0x1f8616bf0bc9744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452953:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452959:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452967:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452984:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612772.452988:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.452995:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453007:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:0.0:1788612772.453010:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612772.453028:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453035:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc9736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453048:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453054:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453060:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453065:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612772.453067:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453239:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453258:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9612fb831300) 00010000:00010000:0.0:1788612772.453261:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612772.453264:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453270:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc973d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453301:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc972f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22627 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453315:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3000/0x1f8616bf0bc9744 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22627 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.453327:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:0.0:1788612772.453329:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612772.453332:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3000, rc 0) 00000100:00100000:0.0:1788612772.453495:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+7:15596:x1875495914436480:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1184us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612772.453504:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1788612772.459844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.459944:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914436608 00000100:00100000:2.0:1788612772.459952:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914436608 00000100:00100000:2.0:1788612772.460018:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1788612772.460028:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:15596:x1875495914436608:12345-192.168.203.30@tcp:900:lfs.0 00000100:00100000:2.0:1788612772.460109:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:15596:x1875495914436608:12345-192.168.203.30@tcp:900:lfs.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.460117:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00080000:0.0:1788612772.460315:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788612772.465884:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612772.465996:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914436864 00000100:00100000:1.0:1788612772.466006:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914436864 00000100:00100000:1.0:1788612772.466094:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:1.0:1788612772.466104:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+7:15596:x1875495914436864:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612772.466124:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612772.466146:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc974b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2262e expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612772.466278:0:20193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788612772.466379:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc974b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2262e expref: 9 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.466395:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:1.0:1788612772.466398:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612772.466403:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc974b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2262e expref: 9 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.466418:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0000, rc 0) 00000100:00100000:1.0:1788612772.466547:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+8:15596:x1875495914436864:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 444us (672us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788612772.466554:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1788612772.470301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.476494:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914437120 00000100:00100000:2.0:1788612772.476510:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914437120 00000100:00100000:2.0:1788612772.476587:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1788612772.476597:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+8:15596:x1875495914437120:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1788612772.476654:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612772.476681:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3000/0x1f8616bf0bc9744 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22627 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.476702:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:2.0:1788612772.476707:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612772.476729:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.476743:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.476753:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612772.477069:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1751e42 reply state 00000000ade99244 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.477083:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.477090:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:2.0:1788612772.477092:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788612772.477095:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788612772.477102:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788612772.477193:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+9:15596:x1875495914437120:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 596us (6902us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788612772.477210:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1788612772.481870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.481957:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914437376 00000100:00100000:0.0:1788612772.481968:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914437376 00000100:00100000:0.0:1788612772.482033:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788612772.482044:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+9:15596:x1875495914437376:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788612772.482284:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+10:15596:x1875495914437376:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 241us (425us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788612772.482306:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1788612772.487217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612772.487366:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914437632 00000100:00100000:1.0:1788612772.487375:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914437632 00000100:00100000:1.0:1788612772.487439:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788612772.487451:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+10:15596:x1875495914437632:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612772.487939:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612772.487964:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0400/0x1f8616bf0bc9760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22635 expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488111:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488125:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488156:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488169:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488177:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488183:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612772.488293:0:20193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788612772.488366:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488374:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488380:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488385:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612772.488389:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488397:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488408:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:1.0:1788612772.488411:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612772.488422:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488430:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1200/0x1f8616bf0bc9767 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488444:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488450:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488455:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488461:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612772.488463:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.488469:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.489073:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9612fb831300) 00010000:00010000:1.0:1788612772.489079:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612772.489084:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.489091:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc976e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.489134:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0400/0x1f8616bf0bc9760 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22635 expref: 12 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.489158:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:1.0:1788612772.489161:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612772.489165:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0400/0x1f8616bf0bc9760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22635 expref: 12 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.489175:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0400, rc 0) 00000100:00100000:1.0:1788612772.489257:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+11:15596:x1875495914437632:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1808us (2057us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788612772.489265:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788612772.491878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.491968:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914437760 00000100:00100000:0.0:1788612772.491978:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914437760 00000100:00100000:0.0:1788612772.492046:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:0.0:1788612772.492057:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+11:15596:x1875495914437760:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612772.492079:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612772.492099:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc977c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2263c expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.492189:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.492215:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.492227:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612772.492253:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612772.492257:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612772.492276:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.492302:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc977c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.492321:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.492352:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:0.0:1788612772.492355:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612772.492358:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3e00, rc 0) 00000100:00100000:0.0:1788612772.492425:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+12:15596:x1875495914437760:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 369us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612772.492432:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1788612772.496594:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.496879:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914437888 00000100:00100000:0.0:1788612772.496889:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914437888 00000100:00100000:0.0:1788612772.496943:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612772.496954:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+12:15596:x1875495914437888:12345-192.168.203.30@tcp:37:lfs.0 00000100:00100000:0.0:1788612772.504223:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+12:15596:x1875495914437888:12345-192.168.203.30@tcp:37:lfs.0 Request processed in 7261us (7629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612772.504236:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1788612772.507456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612772.507870:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914438144 00000100:00100000:3.0:1788612772.507880:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914438144 00000100:00100000:3.0:1788612772.507948:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788612772.507959:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+12:15596:x1875495914438144:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612772.508172:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+13:15596:x1875495914438144:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 215us (727us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788612772.508181:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788612772.556792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.558537:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914438272 00000100:00100000:0.0:1788612772.558553:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914438272 00000100:00100000:0.0:1788612772.558627:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1788612772.558645:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+11:15602:x1875495914438272:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612772.558665:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612772.558688:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc978a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22643 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558772:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558787:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558812:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558824:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558831:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558838:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558913:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc979f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558922:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc979f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.558929:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc979f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612772.558964:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612772.558968:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612772.559004:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc979f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559029:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559035:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559052:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559058:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612772.559062:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559080:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559092:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:0.0:1788612772.559095:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612772.559099:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559105:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2000/0x1f8616bf0bc9791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559127:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559132:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559138:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559143:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612772.559146:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559162:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559171:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9612fb831300) 00010000:00010000:0.0:1788612772.559173:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612772.559177:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559183:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc9798 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559219:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc978a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22643 expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559233:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc979f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22643 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.559240:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:0.0:1788612772.559242:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788612772.559244:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3a00, rc 0) 00000100:00100000:0.0:1788612772.559315:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+12:15602:x1875495914438272:12345-192.168.203.30@tcp:101:bash.0 Request processed in 673us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612772.559321:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1788612772.564795:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.564882:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914438400 00000100:00100000:2.0:1788612772.564891:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914438400 00000100:00100000:2.0:1788612772.564942:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612772.564952:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:15602:x1875495914438400:12345-192.168.203.30@tcp:900:bash.0 00000100:00100000:2.0:1788612772.565033:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:15602:x1875495914438400:12345-192.168.203.30@tcp:900:bash.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.565041:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788612772.569144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.569857:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914438656 00000100:00100000:0.0:1788612772.569866:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914438656 00000100:00100000:0.0:1788612772.569917:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1788612772.569925:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+12:15602:x1875495914438656:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612772.569953:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612772.569970:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc97a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2264a expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.570063:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.570077:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.570086:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.570120:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.570134:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 12 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612772.570147:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932348672:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612772.570238:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612772.573420:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc725f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932348672:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612772.573457:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612772.573781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612772.573869:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914438784 00000100:00100000:1.0:1788612772.573878:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914438784 00010000:00010000:1.0:1788612772.573921:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612772.573970:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1788612772.573981:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+13:2394:x1875495914438784:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612772.573996:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612772.574003:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.574017:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.574041:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9783 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2263c expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.574071:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:1.0:1788612772.574076:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.574086:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.574094:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612772.574232:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612772.574291:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+12:2394:x1875495914438784:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 311us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612772.574299:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00010000:00010000:0.0:1788612772.574950:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612772.574962:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575031:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575044:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575053:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575557:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575573:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575582:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612772.575593:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788612772.575619:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575625:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575631:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575636:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612772.575652:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575659:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575670:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:2.0:1788612772.575673:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612772.575677:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575693:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc97ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612772.575707:0:17199:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffa15b38 reply state 00000000e5adacdc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575717:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575723:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9612c93f7f00) 00010000:00010000:2.0:1788612772.575725:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612772.575727:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788612772.575762:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2a00/0x1f8616bf0bc97a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575776:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 14 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.575783:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612772.575785:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788612772.575787:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030000, rc 0) 00000100:00100000:2.0:1788612772.575849:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+15:15602:x1875495914438656:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5923us (6713us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788612772.575856:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:3.0:1788612772.596060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.596599:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914438912 00000100:00100000:0.0:1788612772.596611:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914438912 00000100:00100000:2.0:1788612772.596828:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1788612772.596847:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+15:15602:x1875495914438912:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612772.596870:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612772.596907:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22651 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.596976:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.596989:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.597000:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612772.597049:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788612772.597053:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612772.597069:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.597080:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.597102:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 17 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.597121:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.597129:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612772.597132:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612772.597135:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031200, rc 0) 00000100:00100000:2.0:1788612772.597207:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+16:15602:x1875495914438912:12345-192.168.203.30@tcp:101:bash.0 Request processed in 353us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.597224:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:3.0:1788612772.600785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.600939:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914439168 00000100:00100000:0.0:1788612772.600951:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914439168 00000100:00100000:0.0:1788612772.601004:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788612772.601015:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+16:15602:x1875495914439168:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:0.0:1788612772.601413:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+17:15602:x1875495914439168:12345-192.168.203.30@tcp:35:bash.0 Request processed in 399us (636us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788612772.601423:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612772.692829:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.693185:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914439424 00000100:00100000:2.0:1788612772.693203:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914439424 00000100:00100000:2.0:1788612772.693317:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1788612772.693339:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+17:15612:x1875495914439424:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612772.693364:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612772.693384:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22658 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612772.693466:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788612772.693584:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22658 expref: 19 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.693597:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:2.0:1788612772.693600:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612772.693616:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22658 expref: 19 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.693637:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031800, rc 0) 00000100:00100000:2.0:1788612772.693721:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+18:15612:x1875495914439424:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 394us (900us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788612772.693729:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:1.0:1788612772.697213:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612772.697394:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914439680 00000100:00100000:3.0:1788612772.697404:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914439680 00000100:00100000:3.0:1788612772.697567:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612772.697578:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+18:15612:x1875495914439680:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788612772.697785:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+19:15612:x1875495914439680:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 207us (828us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788612772.697793:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612772.748397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.748612:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914439936 00000100:00100000:2.0:1788612772.748621:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914439936 00000100:00100000:2.0:1788612772.748683:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:2.0:1788612772.748693:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+19:15615:x1875495914439936:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612772.748732:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612772.748752:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2265f expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.748854:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc97ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.748868:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc97ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.748895:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc97ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612772.748905:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788612772.749015:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc97e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2265f expref: 22 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.749154:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc97ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2265f expref: 21 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.749164:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612772.749167:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612772.749170:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030e00, rc 0) 00000100:00100000:2.0:1788612772.749237:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+21:15615:x1875495914439936:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 546us (848us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788612772.749244:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1788612772.753406:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612772.753539:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914440064 00000100:00100000:2.0:1788612772.753549:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914440064 00000100:00100000:2.0:1788612772.753614:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788612772.753639:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+21:2397:x1875495914440064:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612772.753654:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612772.753678:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc97ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2265f expref: 21 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612772.753697:0:20223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612772.753702:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612772.753756:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+20:2397:x1875495914440064:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 119us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612772.753763:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788612772.755846:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612772.755940:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914440192 00000100:00100000:3.0:1788612772.755949:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914440192 00000100:00100000:3.0:1788612772.756016:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612772.756026:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+20:15615:x1875495914440192:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1788612772.756112:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756128:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756152:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756213:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756220:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756226:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756231:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f4800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612772.756235:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756243:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756254:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612772.756257:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612772.756262:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612772.756267:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc97fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612772.756338:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+20:15615:x1875495914440192:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 312us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612772.756346:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612772.763347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612772.765325:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914440448 00000100:00100000:0.0:1788612772.765339:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914440448 00000100:00100000:0.0:1788612772.765433:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788612772.765444:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+20:15615:x1875495914440448:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788612772.765849:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+21:15615:x1875495914440448:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 404us (2509us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788612772.765856:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00010000:00010000:3.0:1788612772.784110:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612773.040158:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788612773.042624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.042779:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914440704 00000100:00100000:3.0:1788612773.042789:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914440704 00000100:00100000:3.0:1788612773.042852:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1788612773.042863:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+21:15646:x1875495914440704:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1788612773.042885:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612773.042905:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc9801 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22666 expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.043020:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc9808 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.043034:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc9808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.043046:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc9808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612773.043057:0:20193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788612773.043178:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc9801 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22666 expref: 24 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.043207:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc9808 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22666 expref: 23 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.043216:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612773.043219:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612773.043222:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4000, rc 0) 00000100:00100000:3.0:1788612773.043286:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+23:15646:x1875495914440704:12345-192.168.203.30@tcp:101:cat.0 Request processed in 425us (672us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788612773.043309:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1788612773.049912:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.053582:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914440960 00000100:00100000:3.0:1788612773.053606:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914440960 00000100:00100000:3.0:1788612773.053674:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788612773.053684:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+23:15646:x1875495914440960:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1788612773.054702:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+24:15646:x1875495914440960:12345-192.168.203.30@tcp:35:cat.0 Request processed in 1013us (4793us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788612773.054712:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612773.054960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.057643:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914441088 00000100:00100000:2.0:1788612773.057657:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914441088 00000100:00100000:2.0:1788612773.057734:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788612773.057745:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+24:2395:x1875495914441088:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612773.057760:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.057785:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc9808 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22666 expref: 24 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.057808:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612773.057812:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612773.057886:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+23:2395:x1875495914441088:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 143us (2927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.057894:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1788612773.124260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.124420:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914441344 00000100:00100000:3.0:1788612773.124430:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914441344 00000100:00100000:3.0:1788612773.124527:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1788612773.124537:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+23:15652:x1875495914441344:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788612773.124561:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612773.124584:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc9816 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2266d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124702:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124717:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124726:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 24 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124745:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124808:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 24 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124824:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 24 pid: 17200 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612773.124838:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932348800:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612773.124926:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.124935:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 24 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612773.124945:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932348928:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612773.124965:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612773.128708:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932348800:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612773.128723:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932348928:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612773.128763:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.129096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.129138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.130254:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914441472 00000100:00100000:2.0:1788612773.130263:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914441472 00010000:00010000:2.0:1788612773.130320:0:20223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 25 pid: 17200 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.130360:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914441600 00000100:00100000:2.0:1788612773.130364:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914441600 00010000:00010000:2.0:1788612773.130377:0:20223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 26 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.130413:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1788612773.130423:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+26:2394:x1875495914441472:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612773.130437:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.130444:0:20223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 26 pid: 17200 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.130459:0:20223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 26 pid: 17200 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.130496:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc97d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22651 expref: 26 pid: 17200 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.130503:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:2.0:1788612773.130520:0:20223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00000100:00100000:1.0:1788612773.130521:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+25:2394:x1875495914441600:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612773.130528:0:20223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.130534:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.130540:0:20223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.130543:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 25 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.130552:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612773.130574:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 25 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.130600:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc97bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2264a expref: 25 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.130607:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+25:2394:x1875495914441472:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 183us (1511us total) trans 0 rc 0/0 00010000:00010000:1.0:1788612773.130616:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:1.0:1788612773.130624:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.130629:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00010000:00010000:1.0:1788612773.130636:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.130645:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.130668:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612773.130692:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+24:2394:x1875495914441600:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 177us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.130699:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:1.0:1788612773.130920:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.130929:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612773.130948:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612773.131975:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4800/0x1f8616bf0bc9816 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2266d expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.132078:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2266d expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.132087:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:1.0:1788612773.132090:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612773.132092:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613020f4e00, rc 0) 00000100:00100000:1.0:1788612773.132152:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+23:15652:x1875495914441344:12345-192.168.203.30@tcp:101:dd.0 Request processed in 7616us (7901us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788612773.132160:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1788612773.135458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.135595:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914441728 00000100:00100000:3.0:1788612773.135605:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914441728 00000100:00100000:3.0:1788612773.135661:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1788612773.135672:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+23:15652:x1875495914441728:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788612773.135697:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612773.135729:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc982b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22674 expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.135793:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.135807:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.135819:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.135931:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4000/0x1f8616bf0bc982b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 25 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.135950:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 24 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.135958:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612773.135961:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612773.135963:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81da600, rc 0) 00000100:00100000:3.0:1788612773.136028:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+24:15652:x1875495914441728:12345-192.168.203.30@tcp:101:dd.0 Request processed in 358us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612773.136035:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1788612773.138927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612773.139017:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914441984 00000100:00100000:0.0:1788612773.139027:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914441984 00000100:00100000:0.0:1788612773.139085:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1788612773.139096:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+24:15652:x1875495914441984:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788612773.139340:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.139358:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.139383:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612773.139428:0:17198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788612773.139454:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062b225bf reply state 000000007f539794 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.139467:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.139526:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:0.0:1788612773.139530:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612773.139534:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612773.139621:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+27:15652:x1875495914441984:12345-192.168.203.30@tcp:36:dd.0 Request processed in 526us (702us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788612773.139628:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000020:00080000:0.0:1788612773.139633:0:17198:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788612773.142084:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.142163:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914442112 00000100:00100000:3.0:1788612773.142172:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914442112 00000100:00100000:3.0:1788612773.142281:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1788612773.142294:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+27:15652:x1875495914442112:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788612773.142344:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612773.142365:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db600/0x1f8616bf0bc9840 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2267b expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.142419:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db600/0x1f8616bf0bc9840 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2267b expref: 28 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.142435:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db600/0x1f8616bf0bc9840 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2267b expref: 28 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.142453:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612773.142457:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612773.142460:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81db600, rc 0) 00000100:00100000:3.0:1788612773.142538:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15652:x1875495914442112:12345-192.168.203.30@tcp:101:dd.0 Request processed in 246us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612773.142545:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1788612773.156699:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.157319:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914442368 00000100:00100000:2.0:1788612773.157330:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914442368 00000100:00100000:2.0:1788612773.157405:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788612773.157415:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15652:x1875495914442368:12345-192.168.203.30@tcp:103:dd.0 00010000:00010000:2.0:1788612773.157430:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.157453:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db600/0x1f8616bf0bc9840 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2267b expref: 28 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.157473:0:20223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612773.157535:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612773.157588:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+27:15652:x1875495914442368:12345-192.168.203.30@tcp:103:dd.0 Request processed in 174us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.157608:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788612773.160050:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.160130:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914442496 00000100:00100000:2.0:1788612773.160139:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914442496 00000100:00100000:2.0:1788612773.160209:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1788612773.160218:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+27:15652:x1875495914442496:12345-192.168.203.30@tcp:58:dd.0 00010000:00010000:2.0:1788612773.160323:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.160342:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.160353:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612773.161705:0:17198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612773.162165:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788612773.162416:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788612773.162612:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+27:15652:x1875495914442496:12345-192.168.203.30@tcp:58:dd.0 Request processed in 2390us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.162623:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1788612773.165579:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.165828:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914442624 00000100:00100000:1.0:1788612773.165838:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914442624 00000100:00100000:1.0:1788612773.165930:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:1.0:1788612773.165940:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+27:15652:x1875495914442624:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788612773.165958:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612773.165978:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22682 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.166041:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.166054:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.166073:0:17200:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.166102:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.166116:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:1.0:1788612773.166119:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612773.166122:0:17200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.166130:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1c00, rc 0) 00000100:00100000:1.0:1788612773.166186:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15652:x1875495914442624:12345-192.168.203.30@tcp:101:dd.0 Request processed in 247us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.166203:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000040:00080000:2.0:1788612773.167702:0:17232:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788612773.167709:0:17232:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612773.167749:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788612773.167755:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788612773.167876:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17232:1875495932349056:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612773.169430:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7ad2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612773.176995:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.178448:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914442752 00000100:00100000:1.0:1788612773.178460:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914442752 00000100:00100000:2.0:1788612773.178561:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17232:1875495932349056:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612773.178570:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1788612773.178582:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+29:15653:x1875495914442752:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612773.178610:0:17199:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612773.178731:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15653:x1875495914442752:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 150us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.178738:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:2.0:1788612773.181768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.181837:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914442880 00000100:00100000:3.0:1788612773.181846:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914442880 00000100:00100000:3.0:1788612773.181902:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:3.0:1788612773.181913:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15653:x1875495914442880:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788612773.181989:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182016:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182048:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182109:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182117:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182124:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182148:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182158:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182164:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612773.182218:0:20193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788612773.182222:0:20193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612773.182237:0:20193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182247:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182254:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182272:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182277:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81db800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612773.182282:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182290:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182315:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9612fb831700) 00010000:00010000:3.0:1788612773.182318:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612773.182322:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182329:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc9855 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182343:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182350:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182356:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182361:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81dac00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612773.182364:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182380:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182388:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9611c76e6f00) 00010000:00010000:3.0:1788612773.182391:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612773.182394:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182399:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc985c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182414:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182420:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182426:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182430:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81db400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612773.182433:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182439:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182445:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612773.182448:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612773.182450:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.182465:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc9863 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612773.183090:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15653:x1875495914442880:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1175us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612773.183099:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1788612773.191893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.191996:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914443136 00000100:00100000:1.0:1788612773.192072:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914443136 00000100:00100000:1.0:1788612773.192182:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:1.0:1788612773.192203:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+28:15653:x1875495914443136:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612773.192223:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612773.192258:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0600/0x1f8616bf0bc986a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22689 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192387:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192405:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192417:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612773.192427:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612773.192787:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192795:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192802:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192808:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612773.192812:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192821:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192833:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:1.0:1788612773.192836:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788612773.192840:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192856:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc9871 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192895:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0600/0x1f8616bf0bc986a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22689 expref: 30 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192905:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9612fb831700) 00010000:00010000:1.0:1788612773.192908:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612773.192911:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0600/0x1f8616bf0bc986a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22689 expref: 30 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.192919:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0600, rc 0) 00000100:00100000:1.0:1788612773.192985:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+29:15653:x1875495914443136:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 794us (1102us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788612773.192992:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1788612773.195529:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.199755:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914443264 00000100:00100000:1.0:1788612773.199771:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914443264 00000100:00100000:1.0:1788612773.199827:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1788612773.199837:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+29:15653:x1875495914443264:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612773.199873:0:17199:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612773.199997:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+29:15653:x1875495914443264:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 161us (4475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.200018:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1788612773.204357:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612773.205002:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914443520 00000100:00100000:0.0:1788612773.205014:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914443520 00000100:00100000:0.0:1788612773.205127:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1788612773.205140:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+29:15653:x1875495914443520:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612773.205159:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612773.205179:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc987f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22690 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612773.205755:0:17198:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1788612773.205763:0:17198:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788612773.206112:0:17198:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788612773.206284:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9886 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.206738:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9886 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.206753:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9886 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.206892:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc987f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22690 expref: 32 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.206913:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9886 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22690 expref: 31 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.206923:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9611c65f7c00) 00010000:00010000:0.0:1788612773.206926:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612773.206930:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3e00, rc 0) 00000100:00100000:0.0:1788612773.207039:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+31:15653:x1875495914443520:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1901us (2690us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788612773.207047:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1788612773.209819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.209961:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914443776 00000100:00100000:3.0:1788612773.209971:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914443776 00000100:00100000:3.0:1788612773.210035:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1788612773.210047:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+31:15653:x1875495914443776:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612773.210233:0:20193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.210261:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3e00/0x1f8616bf0bc9886 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22690 expref: 31 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210285:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9611c65f7c00) 00010000:00010000:2.0:1788612773.210352:0:20193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612773.210688:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210704:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210733:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210749:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210756:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210762:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210879:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210886:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210891:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210897:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.210901:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210908:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210918:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:2.0:1788612773.210921:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.210924:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210937:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030000/0x1f8616bf0bc9894 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210949:0:20193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210954:0:20193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210959:0:20193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210964:0:20193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.210967:0:20193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210972:0:20193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210979:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd1b7325a (ffff9612c93f7d00) 00010000:00010000:2.0:1788612773.210982:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.210985:0:20193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.210990:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031800/0x1f8616bf0bc989b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd1b7325a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.211118:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+30:15653:x1875495914443776:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1073us (1361us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612773.211127:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1788612773.213420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.213683:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914443904 00000100:00100000:2.0:1788612773.213692:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914443904 00000100:00100000:2.0:1788612773.213877:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1788612773.213888:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+30:15653:x1875495914443904:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612773.213907:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612773.213927:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc98a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22697 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.213959:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37a00/0x1f8616bf0bc98a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.213972:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37a00/0x1f8616bf0bc98a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.213982:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37a00/0x1f8616bf0bc98a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.214083:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc98a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22697 expref: 32 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.214102:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37a00/0x1f8616bf0bc98a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22697 expref: 31 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.214111:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:2.0:1788612773.214114:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612773.214117:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37a00, rc 0) 00000100:00100000:2.0:1788612773.214180:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+31:15653:x1875495914443904:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 293us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.214187:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1788612773.220128:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612773.220225:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914444160 00000100:00100000:0.0:1788612773.220235:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914444160 00000100:00100000:0.0:1788612773.220293:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1788612773.220303:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+31:15653:x1875495914444160:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612773.220833:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.220850:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.220862:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612773.221022:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788612773.221032:0:17198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 587604555047ns, next at 588604552573ns, rc = 0 00000004:00010000:0.0:1788612773.221076:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5379f1f reply state 000000002d3bc1f5 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.221088:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.221096:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:0.0:1788612773.221099:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788612773.221102:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612773.221205:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+33:15653:x1875495914444160:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 890us (1072us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788612773.221213:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1788612773.224007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.224087:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914444288 00000100:00100000:3.0:1788612773.224096:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914444288 00000100:00100000:3.0:1788612773.224155:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1788612773.224166:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+33:15653:x1875495914444288:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612773.224203:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612773.224223:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2269e expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.224282:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 34 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.224297:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 34 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.224316:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:3.0:1788612773.224332:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612773.224336:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81db400, rc 0) 00000100:00100000:3.0:1788612773.224405:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+34:15653:x1875495914444288:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 240us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612773.224412:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1788612773.229579:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.229751:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914444416 00000100:00100000:2.0:1788612773.229761:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914444416 00000100:00100000:2.0:1788612773.229827:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1788612773.229838:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914444416:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788612773.230075:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2394:x1875495914444416:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 239us (504us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788612773.230084:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00080000:0.0:1788612773.230347:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612773.235931:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612773.236029:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914444672 00000100:00100000:0.0:1788612773.236037:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914444672 00000100:00100000:0.0:1788612773.236085:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788612773.236095:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+34:15653:x1875495914444672:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788612773.236304:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+35:15653:x1875495914444672:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 203us (375us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788612773.236323:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1788612773.244138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.244349:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914444928 00000100:00100000:2.0:1788612773.244359:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914444928 00000100:00100000:2.0:1788612773.244437:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:2.0:1788612773.244448:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+35:15653:x1875495914444928:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788612773.244588:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+35:15653:x1875495914444928:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 142us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.244597:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1788612773.248087:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.248185:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914445056 00000100:00100000:3.0:1788612773.248205:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914445056 00000100:00100000:3.0:1788612773.248271:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1788612773.248281:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+35:15653:x1875495914445056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612773.248301:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612773.248322:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc98be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d226a5 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.248391:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc98c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.248405:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc98c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.248417:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc98c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612773.248464:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612773.249174:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc98c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.249224:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81dac00/0x1f8616bf0bc98be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226a5 expref: 37 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.249243:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc98c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226a5 expref: 36 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.249251:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:0.0:1788612773.249254:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612773.249258:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81db800, rc 0) 00000100:00100000:0.0:1788612773.249368:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+36:15653:x1875495914445056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612773.249376:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1788612773.252349:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.252424:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914445184 00000100:00100000:2.0:1788612773.252434:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914445184 00000100:00100000:2.0:1788612773.252511:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1788612773.252520:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e950a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2395:x1875495914445184:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612773.252537:0:18704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612773.252555:0:18704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d226ac expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612773.252581:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c10a5, blocks: 0x0 00010000:00010000:2.0:1788612773.252610:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1788612773.252615:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612773.252624:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 7 pid: 18704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.252658:0:18704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 7 pid: 18704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.252672:0:18704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37800, rc 0) 00000100:00100000:2.0:1788612773.253231:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e950a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:2395:x1875495914445184:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 709us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.253238:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1788612773.255631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.255710:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914445440 00000100:00100000:1.0:1788612773.255718:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914445440 00000100:00100000:1.0:1788612773.255768:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1788612773.255778:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+36:15653:x1875495914445440:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788612773.255863:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+36:15653:x1875495914445440:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.255870:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1788612773.260724:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.260814:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914445568 00000100:00100000:2.0:1788612773.260824:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914445568 00000100:00100000:2.0:1788612773.260875:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:2.0:1788612773.260884:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+36:15653:x1875495914445568:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788612773.262566:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788612773.262591:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788612773.262646:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788612773.262863:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612773.262883:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932349184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788612773.262945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612773.262985:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932349184 00000100:00100000:3.0:1788612773.262997:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932349184 00000100:00100000:3.0:1788612773.263055:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612773.263062:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932349184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788612773.263169:0:18706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788612773.263172:0:18706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788612773.263175:0:18706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788612773.263177:0:18706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788612773 -> 1788612773 00002000:00010000:3.0:1788612773.263180:0:18706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788612773.263226:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932349184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (281us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788612773.263233:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1788612773.263273:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9612fc714700/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788612773.263278:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932349184:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788612773.263289:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788612773.263427:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263439:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263447:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263453:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.263458:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263466:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263526:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9612fb831300) 00010000:00010000:2.0:1788612773.263530:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.263535:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263541:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0800/0x1f8616bf0bc9705 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263562:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263568:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263573:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263578:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.263581:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263596:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263605:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:2.0:1788612773.263607:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.263610:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263616:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0e00/0x1f8616bf0bc970c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263640:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263646:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263652:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263657:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.263660:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263666:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263673:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9612c93f7f00) 00010000:00010000:2.0:1788612773.263675:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.263678:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263684:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc97b4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263698:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263703:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263709:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263718:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.263721:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263727:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263734:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612773.263736:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.263739:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263744:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bc9839 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263754:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263760:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263766:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263771:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.263774:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263780:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263796:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:2.0:1788612773.263798:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788612773.263801:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.263807:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bc98b0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.263900:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+15:15653:x1875495914445568:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 3015us (3184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.263908:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00010000:00010000:0.0:1788612773.264062:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.264070:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.264077:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.264082:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612773.264085:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.264100:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.264109:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:0.0:1788612773.264111:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788612773.264114:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.264120:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9759 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612773.267070:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.267181:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914445696 00000100:00100000:2.0:1788612773.267200:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914445696 00000100:00100000:2.0:1788612773.267258:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1788612773.267269:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:2394:x1875495914445696:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788612773.267367:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:2394:x1875495914445696:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.267374:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:3.0:1788612773.269684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.269782:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914445952 00000100:00100000:1.0:1788612773.269791:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914445952 00000100:00100000:1.0:1788612773.269848:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1788612773.269857:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+15:15653:x1875495914445952:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612773.269908:0:20193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612773.269935:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db800/0x1f8616bf0bc98c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226a5 expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.269952:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:1.0:1788612773.269957:0:20193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612773.269985:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.270023:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.270033:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612773.270155:0:20193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059af929c reply state 00000000d6b6f8e5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.270166:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.270172:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:1.0:1788612773.270174:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612773.270177:0:20193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612773.270283:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+16:15653:x1875495914445952:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 427us (606us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788612773.270290:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1788612773.273544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.273725:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446080 00000100:00100000:2.0:1788612773.273733:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446080 00000100:00100000:2.0:1788612773.273793:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612773.273803:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:15653:x1875495914446080:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612773.273820:0:18706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612773.273839:0:18706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d226b3 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.273891:0:18706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.273900:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612773.273904:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612773.273909:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 8 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.273941:0:18706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.273955:0:18706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.273969:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18706:1875495932349312:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612773.274222:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612773.277416:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18706:1875495932349312:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612773.277457:0:18706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 8 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.277846:0:18706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37c00, rc 0) 00000100:00100000:2.0:1788612773.277909:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+8:15653:x1875495914446080:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4107us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.277935:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1788612773.278928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.279004:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446208 00000100:00100000:2.0:1788612773.279011:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446208 00010000:00010000:2.0:1788612773.279046:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.279090:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612773.279100:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+8:2395:x1875495914446208:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612773.279113:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.279134:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.279149:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.279172:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc98cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ac expref: 8 pid: 18704 timeout: 687 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.279188:0:17184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612773.279202:0:17184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612773.279209:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 7 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.279219:0:17184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 7 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.279273:0:17184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 7 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.279287:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17184:1875495932349440:192.168.203.30@tcp:105: 00000100:00100000:2.0:1788612773.279429:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d819d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612773.282669:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17184:1875495932349440:192.168.203.30@tcp:105: 00010000:00010000:2.0:1788612773.282698:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612773.283517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.283576:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:2395:x1875495914446208:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 4475us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.283597:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1788612773.283679:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446336 00000100:00100000:0.0:1788612773.283686:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446336 00000100:00100000:0.0:1788612773.283734:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1788612773.283743:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:2395:x1875495914446336:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788612773.283892:0:19152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788612773.283896:0:19152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788612773 00002000:00010000:0.0:1788612773.283898:0:19152:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788612772 00002000:00010000:0.0:1788612773.283901:0:19152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788612773 -> 1788612773 00002000:00010000:0.0:1788612773.283903:0:19152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788612773.283949:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+8:2395:x1875495914446336:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 207us (437us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788612773.283956:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:1.0:1788612773.288516:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.288722:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446464 00000100:00100000:3.0:1788612773.288731:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446464 00000100:00100000:3.0:1788612773.288842:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:3.0:1788612773.288853:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+8:2395:x1875495914446464:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788612773.288897:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.288918:0:18707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 8 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.288928:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612773.288946:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612773.288952:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.288986:0:18707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 8 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.289014:0:18707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 8 pid: 18706 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612773.289029:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18707:1875495932349568:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612773.289108:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612773.293182:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18707:1875495932349568:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612773.293224:0:18707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.296381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.296827:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446592 00000100:00100000:2.0:1788612773.296838:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446592 00010000:00010000:2.0:1788612773.296880:0:20223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 9 pid: 18706 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.296926:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612773.296937:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+9:2395:x1875495914446592:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612773.296951:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612773.296974:0:20223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 9 pid: 18706 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.296994:0:20223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 9 pid: 18706 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.297067:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5087d9a/0x1f8616bf0bc98da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226b3 expref: 9 pid: 18706 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.297083:0:20223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612773.297088:0:20223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612773.297094:0:20223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.297105:0:20223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.297140:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612773.297220:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+8:2395:x1875495914446592:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 284us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.297227:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00010000:00010000:3.0:1788612773.297287:0:18707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297372:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297397:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297405:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297413:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297432:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81dba00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612773.297436:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297445:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297458:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.297466:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab0e562/0x1f8616bf0bc98e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612773.297724:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+7:2395:x1875495914446464:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 8872us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612773.297732:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1788612773.299572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612773.302212:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446848 00000100:00100000:0.0:1788612773.302228:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446848 00000100:00100000:1.0:1788612773.303869:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:1.0:1788612773.303883:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+16:15653:x1875495914446848:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788612773.303976:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.304007:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 16 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.304017:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.304050:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 16 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.304065:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 16 pid: 20193 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.304079:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932349696:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612773.304216:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea1d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788612773.309571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.309946:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914446976 00000100:00100000:3.0:1788612773.309954:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914446976 00010000:00010000:3.0:1788612773.309992:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 17 pid: 20193 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612773.310039:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1788612773.310049:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+17:2394:x1875495914446976:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612773.310063:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612773.310079:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 17 pid: 20193 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.310095:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 17 pid: 20193 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.310118:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612773.310124:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 17 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.310135:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.310144:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.310152:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612773.310171:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612773.310231:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+17:2394:x1875495914446976:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 182us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612773.310239:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00010000:00010000:2.0:1788612773.310522:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81da600/0x1f8616bf0bc9832 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22674 expref: 16 pid: 20193 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.310538:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932349696:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612773.310557:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310566:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310572:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310795:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310808:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310815:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310844:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.310858:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 16 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.310872:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932349824:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612773.310935:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c133a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612773.315657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.315755:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914447104 00000100:00100000:1.0:1788612773.315773:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914447104 00010000:00010000:1.0:1788612773.315815:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 17 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.315868:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1788612773.315880:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+17:2395:x1875495914447104:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612773.315895:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788612773.315900:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932349824:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612773.315905:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 17 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.315927:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.315942:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 17 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.319115:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612e81db400/0x1f8616bf0bc98b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2269e expref: 17 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.319140:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:1.0:1788612773.319145:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.319154:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.319161:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.319204:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612773.319399:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.319410:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.319461:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+16:2395:x1875495914447104:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3581us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.319472:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000001:00080000:2.0:1788612773.321636:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788612773.322156:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788612773.322580:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788612773.322670:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875495932349952:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788612773.322735:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612773.322763:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cf5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612773.323216:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932349952 00000100:00100000:0.0:1788612773.323225:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932349952 00000100:00100000:0.0:1788612773.323289:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788612773.323299:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1875495932349952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788612773.323401:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1875495932349952:12345-0@lo:1000:mdt00_001.0 Request processed in 103us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612773.323408:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612773.323614:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875495932349952:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788612773.323766:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788612773.323819:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875495932350080:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788612773.323872:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612773.323905:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cf5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612773.324038:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350080 00000100:00100000:3.0:1788612773.324043:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350080 00000100:00100000:3.0:1788612773.324071:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612773.324078:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17199:x1875495932350080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788612773.324204:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17199:x1875495932350080:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (317us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788612773.324218:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612773.324347:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875495932350080:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788612773.324658:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.324669:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.324677:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.324683:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.324687:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.324696:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.324710:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:2.0:1788612773.324713:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612773.324725:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.324733:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37c00/0x1f8616bf0bc98ef lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325078:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325087:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325093:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325099:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.325103:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325110:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325120:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612773.325123:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612773.325130:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325142:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325152:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.325240:0:17199:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.325253:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ada680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932350208:192.168.203.30@tcp:105: 00000100:00100000:2.0:1788612773.325333:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cf5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612773.330070:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612773.330210:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914447232 00000100:00100000:0.0:1788612773.330219:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914447232 00000100:00100000:0.0:1788612773.330275:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788612773.330285:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+20:15652:x1875495914447232:12345-192.168.203.30@tcp:49:dd.0 00000100:00100000:0.0:1788612773.330418:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+20:15652:x1875495914447232:12345-192.168.203.30@tcp:49:dd.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612773.330427:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1788612773.331270:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ada680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875495932350208:192.168.203.30@tcp:105: 00010000:00010000:2.0:1788612773.331300:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331311:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031200/0x1f8616bf0bc9847 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331344:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331358:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331369:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331377:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331383:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331389:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331410:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.331414:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331421:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331433:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612773.331436:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612773.331439:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331444:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37800/0x1f8616bf0bc98f6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331453:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331458:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331464:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331468:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612773.331471:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331578:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331656:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612773.331658:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612773.331662:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.331668:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1a00/0x1f8616bf0bc98e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.331870:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+19:15653:x1875495914446848:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 27987us (32302us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788612773.331879:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000020:00080000:2.0:1788612773.331884:0:17199:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788612773.332762:0:17232:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788612773.332768:0:17232:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612773.332796:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788612773.332803:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788612773.335137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.335171:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.335268:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914447616 00000100:00100000:1.0:1788612773.335277:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914447616 00000100:00100000:1.0:1788612773.335343:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:1.0:1788612773.335354:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+19:15652:x1875495914447616:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788612773.335373:0:20193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612773.335392:0:20193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0400/0x1f8616bf0bc98fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d226ba expref: -99 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.335442:0:20193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc9904 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.335455:0:20193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc9904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.335466:0:20193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc9904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.335842:0:20193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0400/0x1f8616bf0bc98fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ba expref: 21 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612773.335858:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914447488 00010000:00010000:1.0:1788612773.335862:0:20193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc9904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ba expref: 20 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612773.335863:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914447488 00010000:00010000:1.0:1788612773.335870:0:20193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:1.0:1788612773.335873:0:20193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612773.335876:0:20193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0200, rc 0) 00000100:00100000:0.0:1788612773.335895:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1788612773.335903:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+21:15653:x1875495914447488:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788612773.335926:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+21:15652:x1875495914447616:12345-192.168.203.30@tcp:101:dd.0 Request processed in 575us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612773.335932:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000004:00080000:0.0:1788612773.336105:0:17201:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788612773.336134:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788612773.336160:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336181:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336201:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336210:0:17201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336215:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336222:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336239:0:17201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612773.336264:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612773.336270:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336277:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612773.336281:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336288:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336298:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:0.0:1788612773.336301:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788612773.336304:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336320:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bc990b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612773.336330:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612773.336332:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612773.336334:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612773.336374:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+22:15653:x1875495914447488:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 471us (1244us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788612773.336380:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000020:00080000:0.0:1788612773.336384:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788612773.465640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.465683:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.465721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.465763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.465780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.465796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612773.465819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.465915:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448000 00000100:00100000:2.0:1788612773.465924:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448000 00000100:00100000:2.0:1788612773.465980:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448512 00000100:00100000:2.0:1788612773.465983:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448512 00000100:00100000:2.0:1788612773.466007:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448384 00000100:00100000:2.0:1788612773.466010:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448384 00000100:00100000:2.0:1788612773.466029:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612773.466038:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914448000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612773.466104:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914448000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.466112:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612773.466130:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612773.466137:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914448512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612773.466161:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914448512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.466183:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612773.466208:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612773.466215:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914448384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612773.466239:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914448384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.466245:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612773.466266:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448256 00000100:00100000:2.0:1788612773.466269:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448256 00000100:00100000:2.0:1788612773.466308:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914447872 00000100:00100000:2.0:1788612773.466312:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914447872 00000100:00100000:2.0:1788612773.466325:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448128 00000100:00100000:2.0:1788612773.466327:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448128 00000100:00100000:2.0:1788612773.466339:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1788612773.466344:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914448256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612773.466382:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914448256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.466390:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1788612773.466402:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1788612773.466408:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914447872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612773.466431:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2394:x1875495914447872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.466437:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1788612773.466448:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:2.0:1788612773.466454:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914448128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612773.466559:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914448128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 105us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612773.466567:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00080000:3.0:1788612773.466943:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612773.466948:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612773.467097:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914447744 00000100:00100000:0.0:1788612773.467103:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914447744 00000100:00100000:0.0:1788612773.467146:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1788612773.467154:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914447744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612773.467187:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914447744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612773.467202:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:1.0:1788612773.503349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612773.503397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612773.503567:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448640 00000100:00100000:2.0:1788612773.503577:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448640 00000100:00100000:2.0:1788612773.503653:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448768 00000100:00100000:2.0:1788612773.503656:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448768 00000100:00100000:2.0:1788612773.503678:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788612773.503687:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+8:2397:x1875495914448640:12345-192.168.203.30@tcp:4:dd.0 00002000:00010000:2.0:1788612773.503734:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c10a5, atime: 0x6a9c10a4, ctime: 0x6a9c10a5, blocks: 0x0 00010000:00010000:2.0:1788612773.503742:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.503759:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1788612773.503763:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612773.503770:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.503784:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612773.576114:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788612773.576130:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1788612773.576429:0:18711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788612773.576435:0:18711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788612773.576453:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576511:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576521:0:18711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576528:0:18711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612773.576532:0:18711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576542:0:18711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576560:0:18711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576568:0:18711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd5be6ff/0x1f8616bf0bc9912 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612773.576741:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+6:2397:x1875495914448640:12345-192.168.203.30@tcp:4:dd.0 Request processed in 73050us (73398us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788612773.576755:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788612773.576783:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1788612773.576794:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2397:x1875495914448768:12345-192.168.203.30@tcp:4:dd.0 00002000:00010000:1.0:1788612773.576830:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a9c10a5, atime: 0x6a9c10a4, ctime: 0x6a9c10a5, blocks: 0x2000 00010000:00010000:1.0:1788612773.576842:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576853:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788612773.576858:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612773.576864:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612773.576877:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612773.636954:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788612773.637202:0:18711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788612773.637208:0:18711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788612773.637225:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.637237:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.637254:0:18711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.637261:0:18711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612773.637266:0:18711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.637275:0:18711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.637360:0:18711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612773.637370:0:18711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551a2e3f/0x1f8616bf0bc9919 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612773.637534:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2397:x1875495914448768:12345-192.168.203.30@tcp:4:dd.0 Request processed in 60739us (134132us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788612773.637544:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:3.0:1788612773.808116:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612774.832702:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612774.895832:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932350336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612774.895916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612774.895985:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350336 00000100:00100000:2.0:1788612774.896003:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350336 00000100:00100000:2.0:1788612774.896058:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612774.896068:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932350336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788612774.896095:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788612774.900944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932350464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612774.901327:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612774.901391:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350464 00000100:00100000:1.0:1788612774.901398:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350464 00000100:00100000:1.0:1788612774.901440:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788612774.901448:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932350464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612774.901496:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788612774.901533:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932350464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612774.901540:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788612774.901583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932350464:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788612774.901816:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612774.901880:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932350592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612774.901913:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612774.901942:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788612774.901951:0:18708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788612774.902114:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350592 00000100:00100000:3.0:1788612774.902118:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350592 00000100:00100000:3.0:1788612774.902218:0:20368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612774.902226:0:20368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932350592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612774.902239:0:20368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612774.902274:0:20368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932350592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612774.902285:0:20368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612774.902309:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788612774.902314:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9612fc714700, transno 8589934596 00000100:00100000:2.0:1788612774.902320:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932350336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6253us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612774.902333:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00080000:3.0:1788612774.902393:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788612774.902415:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932350592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612774.903360:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932350336:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788612774.938678:0:20374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788612775.407921:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932350720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612775.407989:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788612775.408197:0:17232:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788612775.408203:0:17232:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612775.408222:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788612775.408228:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788612775.408509:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350720 00000100:00100000:3.0:1788612775.408517:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350720 00000100:00100000:3.0:1788612775.408563:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612775.408572:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932350720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612775.408601:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788612775.408666:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932350720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612775.408674:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612775.408910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932350720:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612775.857222:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42676 lines, 42676 kept, 0 dropped, 0 bad.